Sep 04 15:42:52 devstack cinder-volume[76574]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 04 15:42:52 devstack cinder-volume[76574]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 15:42:52 devstack cinder-volume[76574]: we strongly recommend against using it for new projects. Sep 04 15:42:52 devstack cinder-volume[76574]: If you are already using Eventlet, we recommend migrating to a different Sep 04 15:42:52 devstack cinder-volume[76574]: framework. For more detail see Sep 04 15:42:52 devstack cinder-volume[76574]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 15:42:52 devstack cinder-volume[76574]: import eventlet # noqa Sep 04 15:42:55 devstack cinder-volume[76574]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76574) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 15:42:55 devstack cinder-volume[76574]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76574) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 15:42:55 devstack cinder-volume[76574]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76574) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 15:42:56 devstack cinder-volume[76574]: INFO dbcounter [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Registered counter for database cinder Sep 04 15:42:56 devstack cinder-volume[76574]: DEBUG oslo_db.sqlalchemy.engines [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76574) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:42:56 devstack cinder-volume[76574]: DEBUG dbcounter [-] [76574] Writer thread running {{(pid=76574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 15:42:56 devstack cinder-volume[76574]: INFO cinder.rpc [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 04 15:42:56 devstack cinder-volume[76574]: INFO cinder.rpc [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 04 15:42:56 devstack cinder-volume[76574]: DEBUG oslo_db.sqlalchemy.engines [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76574) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:42:56 devstack cinder-volume[76574]: INFO cinder.volume.manager [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Determined volume DB was empty at startup. Sep 04 15:42:56 devstack cinder-volume[76574]: DEBUG cinder.volume.manager [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76574) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 04 15:42:56 devstack cinder-volume[76574]: INFO cinder.volume.manager [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 04 15:42:56 devstack cinder-volume[76574]: WARNING stevedore.named [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 15:42:56 devstack cinder-volume[76574]: WARNING castellan.key_manager [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 15:42:56 devstack cinder-volume[76574]: WARNING cinder.keymgr.conf_key_mgr [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 15:42:56 devstack cinder-volume[76574]: DEBUG cinder.volume.drivers.lvm [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76574) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 04 15:42:56 devstack cinder-volume[76574]: DEBUG oslo_concurrency.processutils [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_concurrency.processutils [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] CMD "cinder-rtstool verify" returned: 0 in 0.415s {{(pid=76574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_db.sqlalchemy.engines [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76574) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:42:57 devstack cinder-volume[76574]: INFO cinder.rpc [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 04 15:42:57 devstack cinder-volume[76574]: INFO cinder.rpc [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 04 15:42:57 devstack cinder-volume[76574]: WARNING stevedore.named [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 15:42:57 devstack cinder-volume[76574]: WARNING castellan.key_manager [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 15:42:57 devstack cinder-volume[76574]: INFO cinder.volume.manager [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_db.sqlalchemy.engines [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76574) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:42:57 devstack cinder-volume[76574]: INFO oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Starting 1 workers Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Started child 76739 {{(pid=76574) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Full set of CONF: {{(pid=76574) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] ******************************************************************************** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Configuration options gathered from: {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] ================================================================================ {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] allow_availability_zone_fallback = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] allow_compression_on_image_upload = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] allowed_direct_url_schemes = [] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] api_rate_limit = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76739]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] auth_strategy = keystone {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] az_cache_duration = 3600 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_availability_zone = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_host = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_name = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_stats_polling_interval = 60 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backup_api_class = cinder.backup.api.API {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backup_name_template = backup-%s {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backup_use_same_host = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backup_use_temp_snapshot = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] chap_password = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] chap_username = {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cinder_internal_tenant_project_id = fc39c85070464e02a277bea445b663ad {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cinder_internal_tenant_user_id = 3c3371218d104979ba4b6d9449d1ba7a {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cloned_volume_same_az = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cluster = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] compression_format = gzip {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] compute_api_class = cinder.compute.nova.API {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] config_dir = [] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] config_source = [] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] control_exchange = openstack {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] debug = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] default_availability_zone = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] default_group_type = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] default_volume_type = lvmdriver-1 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] disk_geometry = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] driver_client_cert = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] driver_client_cert_key = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] driver_data_namespace = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] driver_ssl_cert_path = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] driver_ssl_cert_verify = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] driver_use_ssl = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] enable_force_upload = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] enable_new_services = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] enable_unsupported_driver = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] enabled_backends = ['lvmdriver-1'] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] enforce_multipath_for_image_xfer = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] filter_function = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance_api_insecure = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance_api_servers = ['http://192.168.122.48/image'] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance_api_ssl_compression = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance_ca_certificates_file = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance_catalog_info = image:glance:publicURL {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance_certfile = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance_keyfile = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance_num_retries = 3 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance_request_timeout = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] goodness_function = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] graceful_shutdown_timeout = 5 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] group_api_class = cinder.group.api.API {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] host = devstack {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] image_compress_on_upload = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] image_conversion_address_space_limit = 1 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] image_conversion_cpu_limit = 60 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] image_conversion_disable = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] image_upload_use_cinder_backend = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] image_upload_use_internal_tenant = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] image_volume_cache_enabled = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] image_volume_cache_max_count = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] image_volume_cache_max_size_gb = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] init_host_max_objects_retrieval = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] instance_format = [instance: %(uuid)s] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] iscsi_target_flags = {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] iscsi_write_cache = on {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] iser_helper = tgtadm {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] iser_ip_address = 192.168.122.48 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] iser_port = 3260 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] log_color = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] log_config_append = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] log_dir = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] log_file = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] log_options = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] log_rotate_interval = 1 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] log_rotate_interval_type = days {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76739]: INFO cinder.volume.manager [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] log_rotation_type = none {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] max_age = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] max_logfile_count = 30 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] max_logfile_size_mb = 200 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] max_over_subscription_ratio = 20.0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] message_reap_interval = 86400 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] message_ttl = 2592000 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] migration_create_volume_timeout_secs = 300 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] monkey_patch = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] monkey_patch_modules = [] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] my_ip = 192.168.122.48 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] no_snapshot_gb_quota = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] num_iser_scan_tries = 3 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] num_shell_tries = 3 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] num_volume_device_scan_tries = 3 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] nvmeof_conn_info_version = 1 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] nvmet_ns_id = 10 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] nvmet_port_id = 1 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] osapi_max_limit = 1000 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] osapi_volume_ext_list = [] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] osapi_volume_listen = 0.0.0.0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] osapi_volume_listen_port = 8776 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] osapi_volume_use_ssl = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] osapi_volume_workers = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] per_volume_size_limit = -1 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] periodic_fuzzy_delay = 60 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] periodic_interval = 60 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] project_id_regex = [0-9a-f\-]+ {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] public_endpoint = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] publish_errors = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] quota_backup_gigabytes = 1000 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] quota_backups = 10 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] quota_gigabytes = 1000 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] quota_groups = 10 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] quota_snapshots = 10 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] quota_volumes = 10 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] rate_limit_burst = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] rate_limit_except_level = CRITICAL {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] rate_limit_interval = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] reinit_driver_count = 3 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] replication_device = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] report_discard_supported = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] report_interval = 120 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] reservation_clean_interval = 86400 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] reservation_expire = 86400 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] reserved_image_namespaces = [] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] reserved_percentage = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] rpc_response_timeout = 120 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] run_external_periodic_tasks = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] scst_target_driver = iscsi {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] scst_target_iqn_name = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] service_down_time = 720 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] shell_completion = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] snapshot_name_template = snapshot-%s {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] snapshot_same_host = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] split_loggers = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] state_path = /opt/stack/data/cinder {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] storage_availability_zone = nova {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] storage_protocol = iSCSI {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] syslog_log_facility = LOG_USER {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] target_helper = lioadm {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] target_ip_address = 192.168.122.48 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] target_port = 3260 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] target_protocol = iscsi {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] target_secondary_ip_addresses = [] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] trace_flags = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] transfer_api_class = cinder.transfer.api.API {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] transport_url = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] until_refresh = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] use_chap_auth = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] use_default_quota_class = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] use_journal = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] use_json = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] use_multipath_for_image_xfer = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] use_stderr = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] use_syslog = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] verify_glance_signatures = enabled {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] volume_api_class = cinder.volume.api.API {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] volume_backend_name = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] volume_clear = zero {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] volume_clear_ionice = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] volume_clear_size = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] volume_copy_bps_limit = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] volume_dd_blocksize = 1M {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] volume_name_template = volume-%s {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] volume_service_inithost_offload = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] volume_usage_audit_period = month {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] zoning_mode = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_concurrency.disable_process_locking = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.auth_section = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.auth_type = password {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.auth_version = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.cache = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.certfile = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.delay_auth_decision = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.http_connect_timeout = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.include_service_catalog = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.insecure = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.interface = public {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.keyfile = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.memcache_password = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.memcache_username = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.region_name = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.service_token_roles_required = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.service_type = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.token_cache_time = 300 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.48/identity {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.backend = dogpile.cache.null {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.backend_argument = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.backend_expiration_time = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.config_prefix = cache.oslo {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.debug_cache_backend = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.enable_retry_client = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.enable_socket_keepalive = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.enabled = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.expiration_time = 600 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.hashclient_retry_attempts = 2 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.memcache_dead_retry = 300 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.memcache_pool_maxsize = 10 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.memcache_sasl_enabled = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.password = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.proxies = [] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.redis_db = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.redis_sentinel_service_name = mymaster {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.redis_server = localhost:6379 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.retry_attempts = 2 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.retry_delay = 0.0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.socket_keepalive_count = 1 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.socket_keepalive_idle = 1 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.socket_keepalive_interval = 1 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.socket_timeout = 1.0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.tls_allowed_ciphers = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.tls_cafile = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.tls_certfile = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.tls_enabled = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.tls_keyfile = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cache.username = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] coordination.backend_url = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.asyncio_connection = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.asyncio_slave_connection = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.backend = sqlalchemy {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.connection = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.connection_debug = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.connection_parameters = {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.connection_recycle_time = 3600 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.connection_trace = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.db_inc_retry_interval = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.db_max_retries = 20 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.db_max_retry_interval = 10 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.db_retry_interval = 1 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.max_overflow = 50 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.max_pool_size = 5 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.max_retries = 10 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.mysql_wsrep_sync_wait = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.pool_timeout = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.retry_interval = 10 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.slave_connection = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.sqlite_synchronous = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.synchronous_reader = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] database.use_db_reconnect = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_tracing.insecure = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] profiler.connection_string = messaging:// {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] profiler.enabled = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] profiler.es_doc_type = notification {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] profiler.es_scroll_size = 10000 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] profiler.es_scroll_time = 2m {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] profiler.filter_error_trace = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] profiler.hmac_keys = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] profiler.sentinel_service_name = mymaster {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] profiler.socket_timeout = 0.1 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] profiler.trace_requests = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] profiler.trace_sqlalchemy = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] profiler_jaeger.process_tags = {} {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] profiler_jaeger.service_name_prefix = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] profiler_otlp.service_name_prefix = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_policy.enforce_new_defaults = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_policy.policy_default_rule = default {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_policy.policy_file = policy.yaml {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_policy.remote_timeout = 60.0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] privsep_osbrick.group = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] privsep_osbrick.helper_command = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] privsep_osbrick.user = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cinder_sys_admin.group = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cinder_sys_admin.helper_command = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] cinder_sys_admin.user = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] service_user.auth_section = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] service_user.auth_type = password {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] service_user.cafile = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] service_user.certfile = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] service_user.collect_timing = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] service_user.insecure = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] service_user.keyfile = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] service_user.send_service_user_token = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] service_user.split_loggers = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] service_user.timeout = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] service_user.tls_ciphers = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] service_user.tls_min_version = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance.auth_section = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance.auth_type = password {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance.certfile = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance.collect_timing = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance.insecure = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance.keyfile = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance.region_name = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance.split_loggers = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance.timeout = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance.tls_ciphers = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] glance.tls_min_version = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.backend_availability_zone = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.chap_password = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.chap_username = {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.disk_geometry = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack sudo[76781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.driver_client_cert = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.driver_client_cert_key = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.driver_data_namespace = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.driver_use_ssl = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.enable_unsupported_driver = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.extra_capabilities = {} {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.filter_function = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.goodness_function = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.iscsi_target_flags = {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.iscsi_write_cache = on {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack sudo[76781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.iser_helper = tgtadm {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.iser_ip_address = 192.168.122.48 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.iser_port = 3260 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.lvm_mirrors = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.lvm_share_target = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.lvm_type = auto {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.num_shell_tries = 3 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.nvmet_port_id = 1 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.replication_device = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.report_discard_supported = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.reserved_percentage = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.scst_target_driver = iscsi {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.scst_target_iqn_name = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.storage_protocol = iSCSI {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.target_helper = tgtadm {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.target_ip_address = 192.168.122.48 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.target_port = 3260 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.target_protocol = iscsi {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.trace_flags = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.unique_fqdn_network = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.use_chap_auth = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.volume_backend_name = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.volume_clear = zero {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.volume_clear_ionice = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.volume_clear_size = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.volume_group = cinder-volumes {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_reports.file_event_handler = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_reports.log_dir = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.backend_availability_zone = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.backend_host = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.chap_password = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.chap_username = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.chiscsi_conf = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.disk_geometry = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.driver_client_cert = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.driver_data_namespace = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.driver_use_ssl = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.extra_capabilities = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.filter_function = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.goodness_function = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.iser_helper = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.iser_ip_address = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.iser_port = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.iser_target_prefix = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.lvm_conf_file = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.lvm_mirrors = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.lvm_share_target = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.lvm_type = auto {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.num_shell_tries = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.nvmet_port_id = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.replication_device = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.report_discard_supported = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.reserved_percentage = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.scst_target_driver = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.storage_protocol = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.target_helper = lioadm {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.target_ip_address = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.target_port = 3260 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.target_protocol = iscsi {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.trace_flags = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.use_chap_auth = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.volume_clear = zero {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.volume_clear_size = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] lvmdriver-1.volumes_dir = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.ssl = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.ssl_version = {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_notifications.driver = [] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_notifications.retry = -1 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] oslo_messaging_notifications.transport_url = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] key_manager.fixed_key = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican.barbican_api_version = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican.barbican_endpoint = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican.barbican_endpoint_type = public {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican.barbican_region_name = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican.cafile = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican.certfile = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican.collect_timing = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican.insecure = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican.keyfile = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican.number_of_retries = 60 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican.retry_delay = 1 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican.send_service_user_token = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican.split_loggers = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican.timeout = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican.tls_ciphers = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican.tls_min_version = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican.verify_ssl = True {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican.verify_ssl_path = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican_service_user.auth_section = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican_service_user.auth_type = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican_service_user.cafile = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican_service_user.certfile = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican_service_user.collect_timing = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican_service_user.insecure = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican_service_user.keyfile = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican_service_user.split_loggers = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican_service_user.timeout = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican_service_user.tls_ciphers = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] barbican_service_user.tls_min_version = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] vault.approle_role_id = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] vault.approle_secret_id = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] vault.auth_method = approle {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] vault.auth_path = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] vault.kv_mountpoint = secret {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] vault.kv_path = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] vault.kv_version = 2 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] vault.namespace = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] vault.root_token_id = **** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] vault.ssl_ca_crt_file = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] vault.timeout = 60.0 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] vault.token_file = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] vault.token_role = None {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] vault.use_ssl = False {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:57 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] ******************************************************************************** {{(pid=76574) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 04 15:42:57 devstack sudo[76781]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:57 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.357s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:57 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:57 devstack sudo[76924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:42:57 devstack sudo[76924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:58 devstack sudo[76924]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:58 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.346s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:58 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:42:58 devstack cinder-volume[76739]: INFO cinder.brick.local_dev.lvm [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 04 15:42:58 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:58 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:58 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:58 devstack sudo[77027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 15:42:58 devstack sudo[77027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:58 devstack sudo[77027]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:58 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:58 devstack cinder-volume[76739]: DEBUG cinder.brick.local_dev.lvm [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76739) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 04 15:42:58 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:58 devstack sudo[77114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:42:58 devstack sudo[77114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:59 devstack sudo[77114]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:59 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.493s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:59 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:59 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:59 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:59 devstack sudo[77323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:42:59 devstack sudo[77323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:59 devstack sudo[77323]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:59 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:59 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:59 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:59 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:59 devstack sudo[77354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 04 15:42:59 devstack sudo[77354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:59 devstack sudo[77354]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:59 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.243s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:59 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:59 devstack sudo[77390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 15:42:59 devstack sudo[77390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:00 devstack sudo[77390]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:00 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.318s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:00 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:00 devstack sudo[77441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 15:43:00 devstack sudo[77441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:00 devstack sudo[77441]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:00 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:00 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:00 devstack sudo[77450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:43:00 devstack sudo[77450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:00 devstack sudo[77450]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:00 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.334s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:00 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:00 devstack sudo[77533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:43:00 devstack sudo[77533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:00 devstack sudo[77533]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:00 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:00 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:00 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:00 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:00 devstack sudo[77537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:43:00 devstack sudo[77537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:01 devstack sudo[77537]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:01 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:01 devstack cinder-volume[76739]: INFO cinder.volume.drivers.lvm [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 04 15:43:01 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:01 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:01 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:01 devstack sudo[77541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:43:01 devstack sudo[77541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:01 devstack sudo[77541]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:01 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:01 devstack cinder-volume[76739]: DEBUG cinder.volume.drivers.lvm [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Updating volume stats {{(pid=76739) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 15:43:01 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:01 devstack sudo[77550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 15:43:01 devstack sudo[77550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:01 devstack sudo[77550]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:01 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:01 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:01 devstack sudo[77553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:43:01 devstack sudo[77553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:01 devstack sudo[77553]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:01 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:01 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:02 devstack sudo[77556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:43:02 devstack sudo[77556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:02 devstack sudo[77556]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:02 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:02 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:02 devstack sudo[77559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:43:02 devstack sudo[77559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:02 devstack sudo[77559]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:02 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:02 devstack cinder-volume[76739]: INFO cinder.volume.driver [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Driver hasn't implemented _init_vendor_properties() Sep 04 15:43:02 devstack cinder-volume[76739]: DEBUG cinder.volume.driver [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76739) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 04 15:43:02 devstack cinder-volume[76739]: DEBUG oslo_db.sqlalchemy.engines [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76739) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:43:02 devstack cinder-volume[76739]: DEBUG dbcounter [-] [76739] Writer thread running {{(pid=76739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 15:43:02 devstack cinder-volume[76739]: DEBUG cinder.db.api [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Building query based on filter {{(pid=76739) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 04 15:43:02 devstack cinder-volume[76739]: DEBUG cinder.image.image_utils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76739) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 04 15:43:02 devstack cinder-volume[76739]: INFO cinder.keymgr.migration [None req-2daa44df-0465-4dc8-a0b9-041e64cf58d2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 04 15:43:02 devstack cinder-volume[76739]: DEBUG cinder.volume.drivers.lvm [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Updating volume stats {{(pid=76739) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 15:43:02 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:02 devstack sudo[77563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 15:43:02 devstack sudo[77563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:02 devstack sudo[77563]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:02 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:02 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:02 devstack sudo[77567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:43:02 devstack sudo[77567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:03 devstack sudo[77567]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:03 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:03 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:03 devstack sudo[77571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:43:03 devstack sudo[77571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:03 devstack sudo[77571]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:03 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:03 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:03 devstack sudo[77575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:43:03 devstack sudo[77575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:03 devstack sudo[77575]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:03 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:03 devstack cinder-volume[76739]: DEBUG cinder.manager [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Notifying Schedulers of capabilities ... {{(pid=76739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:43:03 devstack cinder-volume[76739]: INFO cinder.volume.manager [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Driver initialization completed successfully. Sep 04 15:43:03 devstack cinder-volume[76739]: INFO cinder.manager [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Initiating service 2 cleanup Sep 04 15:43:03 devstack cinder-volume[76739]: INFO cinder.manager [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Service 2 cleanup completed. Sep 04 15:43:03 devstack cinder-volume[76739]: DEBUG cinder.service [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Creating RPC server for service cinder-volume {{(pid=76739) start /opt/stack/cinder/cinder/service.py:231}} Sep 04 15:43:03 devstack cinder-volume[76739]: DEBUG cinder.service [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76739) start /opt/stack/cinder/cinder/service.py:237}} Sep 04 15:43:03 devstack cinder-volume[76739]: INFO cinder.volume.manager [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 04 15:43:03 devstack cinder-volume[76739]: DEBUG cinder.volume.drivers.lvm [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Updating volume stats {{(pid=76739) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 15:43:03 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:03 devstack sudo[77580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 15:43:03 devstack sudo[77580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:04 devstack sudo[77580]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:04 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:04 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:04 devstack sudo[77583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:43:04 devstack sudo[77583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:04 devstack sudo[77583]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:04 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:04 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:04 devstack sudo[77589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:43:04 devstack sudo[77589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:04 devstack sudo[77589]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:04 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.239s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:04 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:04 devstack sudo[77592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:43:04 devstack sudo[77592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:04 devstack sudo[77592]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:04 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:04 devstack cinder-volume[76739]: INFO cinder.volume.manager [None req-e730755f-886d-4d77-b30a-b32a0bfde76c None None] Driver post RPC initialization completed successfully. Sep 04 15:43:07 devstack cinder-volume[76574]: DEBUG dbcounter [-] [76574] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:43:14 devstack cinder-volume[76739]: DEBUG dbcounter [-] [76739] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:43:15 devstack cinder-volume[76739]: DEBUG dbcounter [-] [76739] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:43:48 devstack cinder-volume[76739]: DEBUG oslo_service.periodic_task [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Running periodic task VolumeManager._thread_info {{(pid=76739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:43:48 devstack cinder-volume[76739]: DEBUG cinder.volume.manager [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] thread count: 6 {{(pid=76739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:43:48 devstack cinder-volume[76739]: DEBUG cinder.volume.manager [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] thread info: [<_MainThread(MainThread, started 138749584375936)>, , , , , ] {{(pid=76739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:44:48 devstack cinder-volume[76739]: DEBUG oslo_service.periodic_task [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:44:48 devstack cinder-volume[76739]: DEBUG cinder.volume.drivers.lvm [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Updating volume stats {{(pid=76739) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 15:44:48 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:44:48 devstack sudo[82780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 15:44:48 devstack sudo[82780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:44:49 devstack sudo[82780]: pam_unix(sudo:session): session closed for user root Sep 04 15:44:49 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:44:49 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:44:49 devstack sudo[82783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:44:49 devstack sudo[82783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:44:49 devstack sudo[82783]: pam_unix(sudo:session): session closed for user root Sep 04 15:44:49 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:44:49 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:44:49 devstack sudo[82786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:44:49 devstack sudo[82786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:44:49 devstack sudo[82786]: pam_unix(sudo:session): session closed for user root Sep 04 15:44:49 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.236s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:44:49 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:44:49 devstack sudo[82789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:44:49 devstack sudo[82789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:44:49 devstack sudo[82789]: pam_unix(sudo:session): session closed for user root Sep 04 15:44:49 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:44:49 devstack cinder-volume[76739]: DEBUG cinder.manager [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Notifying Schedulers of capabilities ... {{(pid=76739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:44:49 devstack cinder-volume[76739]: DEBUG oslo_service.periodic_task [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Running periodic task VolumeManager._thread_info {{(pid=76739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:44:49 devstack cinder-volume[76739]: DEBUG cinder.volume.manager [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] thread count: 6 {{(pid=76739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:44:49 devstack cinder-volume[76739]: DEBUG cinder.volume.manager [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] thread info: [<_MainThread(MainThread, started 138749584375936)>, , , , , ] {{(pid=76739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:45:14 devstack cinder-volume[76739]: DEBUG dbcounter [-] [76739] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:45:48 devstack cinder-volume[76739]: DEBUG oslo_service.periodic_task [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:45:48 devstack cinder-volume[76739]: DEBUG cinder.volume.drivers.lvm [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Updating volume stats {{(pid=76739) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 15:45:48 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:45:48 devstack sudo[84551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 15:45:48 devstack sudo[84551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:45:49 devstack sudo[84551]: pam_unix(sudo:session): session closed for user root Sep 04 15:45:49 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:45:49 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:45:49 devstack sudo[84554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:45:49 devstack sudo[84554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:45:49 devstack sudo[84554]: pam_unix(sudo:session): session closed for user root Sep 04 15:45:49 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:45:49 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:45:49 devstack sudo[84575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:45:49 devstack sudo[84575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:45:49 devstack sudo[84575]: pam_unix(sudo:session): session closed for user root Sep 04 15:45:49 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:45:49 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:45:49 devstack sudo[84580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:45:49 devstack sudo[84580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:45:50 devstack sudo[84580]: pam_unix(sudo:session): session closed for user root Sep 04 15:45:50 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:45:50 devstack cinder-volume[76739]: DEBUG cinder.manager [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Notifying Schedulers of capabilities ... {{(pid=76739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:45:50 devstack cinder-volume[76739]: DEBUG oslo_service.periodic_task [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Running periodic task VolumeManager._thread_info {{(pid=76739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:45:50 devstack cinder-volume[76739]: DEBUG cinder.volume.manager [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] thread count: 6 {{(pid=76739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:45:50 devstack cinder-volume[76739]: DEBUG cinder.volume.manager [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] thread info: [<_MainThread(MainThread, started 138749584375936)>, , , , , ] {{(pid=76739) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:46:48 devstack cinder-volume[76739]: DEBUG oslo_service.periodic_task [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76739) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:46:48 devstack cinder-volume[76739]: DEBUG cinder.volume.drivers.lvm [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Updating volume stats {{(pid=76739) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 15:46:48 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:46:48 devstack sudo[85974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 15:46:48 devstack sudo[85974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:46:49 devstack sudo[85974]: pam_unix(sudo:session): session closed for user root Sep 04 15:46:49 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:46:49 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:46:49 devstack sudo[85980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:46:49 devstack sudo[85980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:46:49 devstack sudo[85980]: pam_unix(sudo:session): session closed for user root Sep 04 15:46:49 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:46:49 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:46:49 devstack sudo[85983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:46:49 devstack sudo[85983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:46:49 devstack sudo[85983]: pam_unix(sudo:session): session closed for user root Sep 04 15:46:49 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:46:49 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:46:49 devstack sudo[85987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:46:49 devstack sudo[85987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:46:49 devstack sudo[85987]: pam_unix(sudo:session): session closed for user root Sep 04 15:46:49 devstack cinder-volume[76739]: DEBUG oslo_concurrency.processutils [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=76739) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:46:49 devstack cinder-volume[76739]: DEBUG cinder.manager [None req-af31930a-d888-4e0f-b335-68890f31aa98 None None] Notifying Schedulers of capabilities ... {{(pid=76739) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:47:14 devstack cinder-volume[76739]: DEBUG dbcounter [-] [76739] Writing DB stats cinder:SELECT=1 {{(pid=76739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:47:14 devstack cinder-volume[76739]: DEBUG dbcounter [-] [76739] Writing DB stats cinder:UPDATE=1 {{(pid=76739) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:47:19 devstack cinder-volume[76574]: INFO oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Caught SIGTERM, stopping children Sep 04 15:47:19 devstack cinder-volume[76574]: DEBUG oslo_concurrency.lockutils [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Acquiring lock "singleton_lock" {{(pid=76574) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 15:47:19 devstack cinder-volume[76574]: DEBUG oslo_concurrency.lockutils [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Acquired lock "singleton_lock" {{(pid=76574) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 15:47:19 devstack cinder-volume[76574]: DEBUG oslo_concurrency.lockutils [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Releasing lock "singleton_lock" {{(pid=76574) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 15:47:19 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Stop services. {{(pid=76574) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 04 15:47:19 devstack cinder-volume[76574]: DEBUG oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Killing children. {{(pid=76574) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 04 15:47:19 devstack cinder-volume[76574]: INFO oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Waiting on 1 children to exit Sep 04 15:47:23 devstack cinder-volume[76739]: DEBUG oslo_concurrency.lockutils [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Acquiring lock "singleton_lock" {{(pid=76739) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 15:47:23 devstack cinder-volume[76739]: DEBUG oslo_concurrency.lockutils [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Acquired lock "singleton_lock" {{(pid=76739) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 15:47:23 devstack cinder-volume[76739]: DEBUG oslo_concurrency.lockutils [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Releasing lock "singleton_lock" {{(pid=76739) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 15:47:23 devstack cinder-volume[76739]: WARNING amqp [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 15:47:23 devstack cinder-volume[76739]: WARNING amqp [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 15:47:23 devstack cinder-volume[76574]: INFO oslo_service.backend._eventlet.service [None req-fd8006ac-1163-4204-8ce7-e5188919b1bd None None] Child 76739 exited with status 0 Sep 04 15:47:24 devstack cinder-volume[86717]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 04 15:47:24 devstack cinder-volume[86717]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 15:47:24 devstack cinder-volume[86717]: we strongly recommend against using it for new projects. Sep 04 15:47:24 devstack cinder-volume[86717]: If you are already using Eventlet, we recommend migrating to a different Sep 04 15:47:24 devstack cinder-volume[86717]: framework. For more detail see Sep 04 15:47:24 devstack cinder-volume[86717]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 15:47:24 devstack cinder-volume[86717]: import eventlet # noqa Sep 04 15:47:26 devstack cinder-volume[86717]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 15:47:26 devstack cinder-volume[86717]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 15:47:26 devstack cinder-volume[86717]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 15:47:26 devstack cinder-volume[86717]: INFO dbcounter [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Registered counter for database cinder Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_db.sqlalchemy.engines [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86717) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG dbcounter [-] [86717] Writer thread running {{(pid=86717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 15:47:27 devstack cinder-volume[86717]: INFO cinder.rpc [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 04 15:47:27 devstack cinder-volume[86717]: INFO cinder.rpc [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_db.sqlalchemy.engines [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86717) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:47:27 devstack cinder-volume[86717]: INFO cinder.volume.manager [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Determined volume DB was empty at startup. Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG cinder.volume.manager [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86717) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 04 15:47:27 devstack cinder-volume[86717]: INFO cinder.volume.manager [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 04 15:47:27 devstack cinder-volume[86717]: WARNING stevedore.named [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 15:47:27 devstack cinder-volume[86717]: WARNING castellan.key_manager [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 15:47:27 devstack cinder-volume[86717]: WARNING cinder.keymgr.conf_key_mgr [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 15:47:27 devstack cinder-volume[86717]: INFO cinder.volume.manager [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_db.sqlalchemy.engines [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86717) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:47:27 devstack cinder-volume[86717]: INFO oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Starting 1 workers Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Started child 86933 {{(pid=86717) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Full set of CONF: {{(pid=86717) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] ******************************************************************************** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Configuration options gathered from: {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] ================================================================================ {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] allow_availability_zone_fallback = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] allow_compression_on_image_upload = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] allowed_direct_url_schemes = [] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] api_rate_limit = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] auth_strategy = keystone {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_availability_zone = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_host = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86933]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_name = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_stats_polling_interval = 60 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backup_api_class = cinder.backup.api.API {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backup_name_template = backup-%s {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backup_use_same_host = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backup_use_temp_snapshot = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] chap_password = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] chap_username = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cinder_internal_tenant_project_id = fc39c85070464e02a277bea445b663ad {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cinder_internal_tenant_user_id = 3c3371218d104979ba4b6d9449d1ba7a {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cluster = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] compression_format = gzip {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] compute_api_class = cinder.compute.nova.API {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] config_dir = [] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] config_source = [] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] control_exchange = openstack {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] debug = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] default_availability_zone = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] default_group_type = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] default_volume_type = QuobyteHD {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] disk_geometry = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] driver_client_cert = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] driver_client_cert_key = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] driver_data_namespace = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] driver_ssl_cert_path = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] driver_ssl_cert_verify = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] driver_use_ssl = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] enable_new_services = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] enable_unsupported_driver = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] enabled_backends = ['QuobyteHD'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] enforce_multipath_for_image_xfer = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] filter_function = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance_api_insecure = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance_api_servers = ['http://192.168.122.48/image'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance_api_ssl_compression = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance_ca_certificates_file = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance_catalog_info = image:glance:publicURL {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance_certfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance_keyfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance_num_retries = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance_request_timeout = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] goodness_function = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] graceful_shutdown_timeout = 5 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] group_api_class = cinder.group.api.API {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] host = devstack {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] image_compress_on_upload = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] image_conversion_address_space_limit = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] image_conversion_cpu_limit = 60 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] image_conversion_disable = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] image_upload_use_cinder_backend = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] image_upload_use_internal_tenant = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] image_volume_cache_enabled = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Starting volume driver QuobyteDriver (1.1.14) Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] image_volume_cache_max_count = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.remotefs [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86933) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] image_volume_cache_max_size_gb = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] init_host_max_objects_retrieval = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] instance_format = [instance: %(uuid)s] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] iscsi_target_flags = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] iscsi_write_cache = on {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] iser_helper = tgtadm {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] iser_ip_address = 192.168.122.48 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] iser_port = 3260 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] log_color = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] log_config_append = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] log_dir = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] log_file = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] log_options = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] log_rotate_interval = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] log_rotate_interval_type = days {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] log_rotation_type = none {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] max_age = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] max_logfile_count = 30 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] max_logfile_size_mb = 200 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] max_over_subscription_ratio = 20.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] message_reap_interval = 86400 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] message_ttl = 2592000 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] migration_create_volume_timeout_secs = 300 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] monkey_patch = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] monkey_patch_modules = [] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] my_ip = 192.168.122.48 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] no_snapshot_gb_quota = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] num_iser_scan_tries = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] num_shell_tries = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] num_volume_device_scan_tries = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] nvmeof_conn_info_version = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] nvmet_ns_id = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] nvmet_port_id = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] osapi_max_limit = 1000 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] osapi_volume_ext_list = [] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] osapi_volume_listen_port = 8776 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] osapi_volume_use_ssl = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] osapi_volume_workers = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] per_volume_size_limit = -1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] periodic_fuzzy_delay = 60 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] periodic_interval = 60 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] public_endpoint = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] publish_errors = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] quota_backup_gigabytes = 1000 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] quota_backups = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] quota_gigabytes = 1000 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] quota_groups = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] quota_snapshots = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] quota_volumes = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] rate_limit_burst = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] rate_limit_except_level = CRITICAL {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] rate_limit_interval = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] reinit_driver_count = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] replication_device = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] report_discard_supported = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] report_interval = 120 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] reservation_clean_interval = 86400 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] reservation_expire = 86400 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] reserved_image_namespaces = [] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] reserved_percentage = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] rpc_response_timeout = 120 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] run_external_periodic_tasks = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] scst_target_driver = iscsi {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] scst_target_iqn_name = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] service_down_time = 720 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] shell_completion = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] snapshot_name_template = snapshot-%s {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] split_loggers = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] state_path = /opt/stack/data/cinder {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] storage_availability_zone = nova {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] storage_protocol = iSCSI {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] syslog_log_facility = LOG_USER {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] target_helper = lioadm {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] target_ip_address = 192.168.122.48 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] target_port = 3260 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] target_protocol = iscsi {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] target_secondary_ip_addresses = [] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] trace_flags = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] transport_url = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] until_refresh = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] use_chap_auth = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] use_default_quota_class = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] use_journal = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] use_json = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] use_multipath_for_image_xfer = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] use_stderr = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] use_syslog = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] verify_glance_signatures = enabled {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] volume_api_class = cinder.volume.api.API {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] volume_backend_name = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] volume_clear = zero {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] volume_clear_ionice = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] volume_clear_size = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] volume_copy_bps_limit = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] volume_dd_blocksize = 1M {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] volume_name_template = volume-%s {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] volume_service_inithost_offload = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] volume_usage_audit_period = month {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] zoning_mode = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_concurrency.disable_process_locking = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.auth_section = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.auth_type = password {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.auth_version = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.cache = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.certfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.include_service_catalog = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.insecure = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.interface = public {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.keyfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.memcache_password = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.memcache_username = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.region_name = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.service_type = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.48/identity {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.backend = dogpile.cache.null {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.backend_argument = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.backend_expiration_time = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.config_prefix = cache.oslo {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.debug_cache_backend = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.enable_retry_client = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.enable_socket_keepalive = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.enabled = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.expiration_time = 600 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.hashclient_retry_attempts = 2 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.memcache_dead_retry = 300 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.memcache_pool_maxsize = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.memcache_sasl_enabled = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.password = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.proxies = [] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.redis_db = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.redis_server = localhost:6379 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.retry_attempts = 2 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.retry_delay = 0.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.socket_keepalive_count = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.socket_keepalive_idle = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.socket_keepalive_interval = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.socket_timeout = 1.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.tls_allowed_ciphers = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.tls_cafile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.tls_certfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.tls_enabled = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.tls_keyfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cache.username = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] coordination.backend_url = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.asyncio_connection = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.asyncio_slave_connection = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.backend = sqlalchemy {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.connection = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.connection_debug = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.connection_parameters = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.connection_recycle_time = 3600 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.connection_trace = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.db_inc_retry_interval = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.db_max_retries = 20 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.db_max_retry_interval = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.db_retry_interval = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.max_overflow = 50 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86933) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Sep 04 15:47:27 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.quobyte [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 04 15:47:27 devstack cinder-volume[86933]: WARNING cinder.volume.drivers.quobyte [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.max_pool_size = 5 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.max_retries = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.mysql_wsrep_sync_wait = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.pool_timeout = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.retry_interval = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.slave_connection = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.sqlite_synchronous = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.synchronous_reader = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] database.use_db_reconnect = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_tracing.insecure = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Running cmd (subprocess): mount.quobyte {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] profiler.connection_string = messaging:// {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] profiler.enabled = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] profiler.es_doc_type = notification {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] profiler.es_scroll_size = 10000 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] profiler.es_scroll_time = 2m {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] profiler.filter_error_trace = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] profiler.hmac_keys = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] profiler.sentinel_service_name = mymaster {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] profiler.socket_timeout = 0.1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] profiler.trace_requests = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] profiler.trace_sqlalchemy = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] profiler_jaeger.process_tags = {} {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] profiler_jaeger.service_name_prefix = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] profiler_otlp.service_name_prefix = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_policy.enforce_new_defaults = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_policy.policy_default_rule = default {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_policy.policy_file = policy.yaml {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] privsep_osbrick.group = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] privsep_osbrick.helper_command = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] privsep_osbrick.user = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cinder_sys_admin.group = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cinder_sys_admin.helper_command = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] cinder_sys_admin.user = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] service_user.auth_section = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] service_user.auth_type = password {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] service_user.cafile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] service_user.certfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] service_user.collect_timing = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] service_user.insecure = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] service_user.keyfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] service_user.send_service_user_token = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] service_user.split_loggers = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] service_user.timeout = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] service_user.tls_ciphers = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] service_user.tls_min_version = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance.auth_section = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance.auth_type = password {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance.certfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance.collect_timing = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance.insecure = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance.keyfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance.region_name = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance.split_loggers = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance.timeout = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance.tls_ciphers = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] glance.tls_min_version = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.backend_availability_zone = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.chap_password = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.chap_username = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.disk_geometry = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.driver_client_cert = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.driver_client_cert_key = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.driver_data_namespace = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.driver_use_ssl = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.extra_capabilities = {} {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.filter_function = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.goodness_function = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.iscsi_target_flags = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.iscsi_write_cache = on {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.iser_helper = tgtadm {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.iser_ip_address = 192.168.122.48 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.iser_port = 3260 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.nas_host = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.nas_login = admin {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.nas_mount_options = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.nas_password = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.nas_private_key = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.nas_share_path = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.num_shell_tries = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.quobyte_volume_url = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.replication_device = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.report_discard_supported = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.reserved_percentage = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.target_helper = tgtadm {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.target_ip_address = 192.168.122.48 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.target_port = 3260 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.target_protocol = iscsi {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:27 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.trace_flags = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.unique_fqdn_network = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.use_chap_auth = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.volume_backend_name = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.volume_clear = zero {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.volume_clear_ionice = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.volume_clear_size = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_reports.file_event_handler = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_reports.log_dir = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.backend_availability_zone = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.backend_host = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.chap_password = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.chap_username = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.chiscsi_conf = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.disk_geometry = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.driver_client_cert = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.driver_data_namespace = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.driver_use_ssl = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.extra_capabilities = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.filter_function = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.goodness_function = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.iser_helper = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.iser_ip_address = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.iser_port = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.iser_target_prefix = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.nas_host = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.nas_login = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.nas_mount_options = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.nas_password = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.nas_private_key = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.nas_share_path = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.nas_ssh_port = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.num_shell_tries = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.nvmet_port_id = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.replication_device = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.report_discard_supported = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.reserved_percentage = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.scst_target_driver = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.storage_protocol = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.target_helper = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.target_ip_address = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.target_port = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.target_prefix = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.target_protocol = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.trace_flags = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.use_chap_auth = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.volume_clear = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.volume_clear_size = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] QuobyteHD.volumes_dir = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] CMD "mount.quobyte" returned: 1 in 0.130s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:47:28 devstack sudo[86939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 -c /etc/quobyte/client-cinder.cfg Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack sudo[86939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:47:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86933]: INFO cinder.volume.drivers.quobyte [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e ... Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 -c /etc/quobyte/client-cinder.cfg {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.ssl = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_notifications.driver = [] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_notifications.retry = -1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] key_manager.fixed_key = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican.barbican_api_version = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican.barbican_endpoint = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican.barbican_endpoint_type = public {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican.barbican_region_name = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican.cafile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican.certfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican.collect_timing = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican.insecure = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican.keyfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican.number_of_retries = 60 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican.retry_delay = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican.send_service_user_token = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican.split_loggers = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican.timeout = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican.tls_ciphers = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican.tls_min_version = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican.verify_ssl = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican.verify_ssl_path = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican_service_user.auth_section = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican_service_user.auth_type = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican_service_user.cafile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican_service_user.certfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican_service_user.collect_timing = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican_service_user.insecure = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican_service_user.keyfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican_service_user.split_loggers = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican_service_user.timeout = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican_service_user.tls_ciphers = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] barbican_service_user.tls_min_version = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] vault.approle_role_id = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] vault.approle_secret_id = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] vault.auth_method = approle {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] vault.auth_path = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] vault.kv_mountpoint = secret {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] vault.kv_path = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] vault.kv_version = 2 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] vault.namespace = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] vault.root_token_id = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] vault.ssl_ca_crt_file = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] vault.timeout = 60.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] vault.token_file = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] vault.token_role = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] vault.use_ssl = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:28 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] ******************************************************************************** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 04 15:47:28 devstack sudo[86939]: pam_unix(sudo:session): session closed for user root Sep 04 15:47:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.368s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:47:28 devstack cinder-volume[86933]: INFO cinder.volume.drivers.quobyte [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e succeeded Sep 04 15:47:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:47:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.381s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:47:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:47:28 devstack sudo[87008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:47:28 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:47:28 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root Sep 04 15:47:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.234s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:47:28 devstack cinder-volume[86933]: INFO cinder.volume.driver [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Driver hasn't implemented _init_vendor_properties() Sep 04 15:47:28 devstack cinder-volume[86933]: DEBUG cinder.volume.driver [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7594451904297, 'free_capacity_gb': 1773.7594451904297, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86933) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 04 15:47:28 devstack cinder-volume[86933]: DEBUG oslo_db.sqlalchemy.engines [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86933) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:47:28 devstack cinder-volume[86933]: DEBUG dbcounter [-] [86933] Writer thread running {{(pid=86933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 15:47:28 devstack cinder-volume[86933]: DEBUG cinder.db.api [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Building query based on filter {{(pid=86933) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 04 15:47:28 devstack cinder-volume[86933]: DEBUG cinder.image.image_utils [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86933) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 04 15:47:28 devstack cinder-volume[86933]: INFO cinder.keymgr.migration [None req-209c9553-89dd-4112-b356-7c49b629b7a0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 04 15:47:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:47:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:47:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:47:28 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:47:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:47:28 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:47:28 devstack sudo[87011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:47:28 devstack sudo[87011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:47:29 devstack sudo[87011]: pam_unix(sudo:session): session closed for user root Sep 04 15:47:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.234s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:47:29 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:47:29 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Driver initialization completed successfully. Sep 04 15:47:29 devstack cinder-volume[86933]: INFO cinder.manager [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Initiating service 3 cleanup Sep 04 15:47:29 devstack cinder-volume[86933]: INFO cinder.manager [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Service 3 cleanup completed. Sep 04 15:47:29 devstack cinder-volume[86933]: DEBUG cinder.service [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Creating RPC server for service cinder-volume {{(pid=86933) start /opt/stack/cinder/cinder/service.py:231}} Sep 04 15:47:29 devstack cinder-volume[86933]: DEBUG cinder.service [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86933) start /opt/stack/cinder/cinder/service.py:237}} Sep 04 15:47:29 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Sep 04 15:47:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:47:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:47:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:47:29 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:47:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:47:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:47:29 devstack sudo[87014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:47:29 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:47:29 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root Sep 04 15:47:29 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.259s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:47:29 devstack cinder-volume[86933]: INFO cinder.volume.manager [None req-d4b1c754-b7e3-45e6-822c-8b27c7d6b095 None None] Driver post RPC initialization completed successfully. Sep 04 15:47:29 devstack cinder-volume[86933]: DEBUG oslo_service.periodic_task [None req-0e382ab1-6b11-4800-b15b-36f6012ac8de None None] Running periodic task VolumeManager._thread_info {{(pid=86933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:47:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0e382ab1-6b11-4800-b15b-36f6012ac8de None None] thread count: 6 {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:47:29 devstack cinder-volume[86933]: DEBUG cinder.volume.manager [None req-0e382ab1-6b11-4800-b15b-36f6012ac8de None None] thread info: [<_MainThread(MainThread, started 140216592793728)>, , , , , ] {{(pid=86933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:47:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5186284f-d4ae-4a45-a0ee-51ba41d6fc86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:47:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5186284f-d4ae-4a45-a0ee-51ba41d6fc86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5186284f-d4ae-4a45-a0ee-51ba41d6fc86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=86933) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:47:34 devstack cinder-volume[86933]: DEBUG cinder.volume.drivers.quobyte [None req-5186284f-d4ae-4a45-a0ee-51ba41d6fc86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=86933) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:47:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-5186284f-d4ae-4a45-a0ee-51ba41d6fc86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86933) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:47:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5186284f-d4ae-4a45-a0ee-51ba41d6fc86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:47:34 devstack sudo[87146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:47:34 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:47:34 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root Sep 04 15:47:34 devstack cinder-volume[86933]: DEBUG oslo_concurrency.processutils [None req-5186284f-d4ae-4a45-a0ee-51ba41d6fc86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.231s {{(pid=86933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:47:34 devstack cinder-volume[86933]: DEBUG cinder.manager [None req-5186284f-d4ae-4a45-a0ee-51ba41d6fc86 None None] Notifying Schedulers of capabilities ... {{(pid=86933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:47:34 devstack cinder-volume[86717]: INFO oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Caught SIGTERM, stopping children Sep 04 15:47:34 devstack cinder-volume[86717]: DEBUG oslo_concurrency.lockutils [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Acquiring lock "singleton_lock" {{(pid=86717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 15:47:34 devstack cinder-volume[86717]: DEBUG oslo_concurrency.lockutils [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Acquired lock "singleton_lock" {{(pid=86717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 15:47:34 devstack cinder-volume[86717]: DEBUG oslo_concurrency.lockutils [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Releasing lock "singleton_lock" {{(pid=86717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 15:47:34 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Stop services. {{(pid=86717) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 04 15:47:34 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Killing children. {{(pid=86717) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 04 15:47:34 devstack cinder-volume[86717]: INFO oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Waiting on 1 children to exit Sep 04 15:47:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Acquiring lock "singleton_lock" {{(pid=86933) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 15:47:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Acquired lock "singleton_lock" {{(pid=86933) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 15:47:37 devstack cinder-volume[86933]: DEBUG oslo_concurrency.lockutils [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Releasing lock "singleton_lock" {{(pid=86933) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 15:47:37 devstack cinder-volume[86933]: WARNING amqp [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 15:47:37 devstack cinder-volume[86933]: WARNING amqp [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 15:47:37 devstack cinder-volume[86717]: INFO oslo_service.backend._eventlet.service [None req-e5e08a0a-a3ed-4da2-9fe7-7f0358449418 None None] Child 86933 exited with status 0 Sep 04 15:47:38 devstack cinder-volume[87214]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 04 15:47:38 devstack cinder-volume[87214]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 15:47:38 devstack cinder-volume[87214]: we strongly recommend against using it for new projects. Sep 04 15:47:38 devstack cinder-volume[87214]: If you are already using Eventlet, we recommend migrating to a different Sep 04 15:47:38 devstack cinder-volume[87214]: framework. For more detail see Sep 04 15:47:38 devstack cinder-volume[87214]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 15:47:38 devstack cinder-volume[87214]: import eventlet # noqa Sep 04 15:47:41 devstack cinder-volume[87214]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 15:47:41 devstack cinder-volume[87214]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 15:47:41 devstack cinder-volume[87214]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 15:47:42 devstack cinder-volume[87214]: INFO dbcounter [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] Registered counter for database cinder Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_db.sqlalchemy.engines [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87214) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG dbcounter [-] [87214] Writer thread running {{(pid=87214) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 15:47:42 devstack cinder-volume[87214]: INFO cinder.rpc [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 04 15:47:42 devstack cinder-volume[87214]: INFO cinder.rpc [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_db.sqlalchemy.engines [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87214) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:47:42 devstack cinder-volume[87214]: INFO cinder.volume.manager [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] Determined volume DB was empty at startup. Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG cinder.volume.manager [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87214) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 04 15:47:42 devstack cinder-volume[87214]: WARNING stevedore.named [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 15:47:42 devstack cinder-volume[87214]: WARNING castellan.key_manager [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 15:47:42 devstack cinder-volume[87214]: WARNING cinder.keymgr.conf_key_mgr [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 15:47:42 devstack cinder-volume[87214]: INFO cinder.volume.manager [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_db.sqlalchemy.engines [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87214) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:47:42 devstack cinder-volume[87214]: INFO oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] Starting 1 workers Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] Started child 87513 {{(pid=87214) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] Full set of CONF: {{(pid=87214) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] ******************************************************************************** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] Configuration options gathered from: {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] ================================================================================ {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] allow_availability_zone_fallback = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] allow_compression_on_image_upload = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87513]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] allowed_direct_url_schemes = [] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] api_rate_limit = True {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] auth_strategy = keystone {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_availability_zone = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_host = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_name = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_stats_polling_interval = 60 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backup_api_class = cinder.backup.api.API {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backup_name_template = backup-%s {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backup_use_same_host = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backup_use_temp_snapshot = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] chap_password = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] chap_username = {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cinder_internal_tenant_project_id = fc39c85070464e02a277bea445b663ad {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cinder_internal_tenant_user_id = 3c3371218d104979ba4b6d9449d1ba7a {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cluster = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] compression_format = gzip {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] compute_api_class = cinder.compute.nova.API {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] config_dir = [] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] config_source = [] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] control_exchange = openstack {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] debug = True {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] default_availability_zone = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] default_group_type = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] default_volume_type = QuobyteHD {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] disk_geometry = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] driver_client_cert = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] driver_client_cert_key = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] driver_data_namespace = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] driver_ssl_cert_path = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] driver_ssl_cert_verify = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] driver_use_ssl = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] enable_new_services = True {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] enable_unsupported_driver = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] enabled_backends = ['QuobyteHD'] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] enforce_multipath_for_image_xfer = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] filter_function = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance_api_insecure = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance_api_servers = ['http://192.168.122.48/image'] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance_api_ssl_compression = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance_ca_certificates_file = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance_catalog_info = image:glance:publicURL {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance_certfile = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance_keyfile = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance_num_retries = 3 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance_request_timeout = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] goodness_function = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] graceful_shutdown_timeout = 5 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] group_api_class = cinder.group.api.API {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] host = devstack {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] image_compress_on_upload = True {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] image_conversion_address_space_limit = 1 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] image_conversion_cpu_limit = 60 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] image_conversion_disable = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] image_upload_use_cinder_backend = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] image_upload_use_internal_tenant = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] image_volume_cache_enabled = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] image_volume_cache_max_count = 0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] image_volume_cache_max_size_gb = 0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] init_host_max_objects_retrieval = 0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] instance_format = [instance: %(uuid)s] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] iscsi_target_flags = {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] iscsi_write_cache = on {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] iser_helper = tgtadm {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] iser_ip_address = 192.168.122.48 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] iser_port = 3260 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Starting volume driver QuobyteDriver (1.1.14) Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87513) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] log_color = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] log_config_append = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] log_dir = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] log_file = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] log_options = True {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] log_rotate_interval = 1 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] log_rotate_interval_type = days {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] log_rotation_type = none {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] max_age = 0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] max_logfile_count = 30 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] max_logfile_size_mb = 200 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] max_over_subscription_ratio = 20.0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] message_reap_interval = 86400 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] message_ttl = 2592000 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] migration_create_volume_timeout_secs = 300 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] monkey_patch = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] monkey_patch_modules = [] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] my_ip = 192.168.122.48 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] no_snapshot_gb_quota = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] num_iser_scan_tries = 3 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] num_shell_tries = 3 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] num_volume_device_scan_tries = 3 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] nvmeof_conn_info_version = 1 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] nvmet_ns_id = 10 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] nvmet_port_id = 1 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] osapi_max_limit = 1000 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] osapi_volume_ext_list = [] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] osapi_volume_listen_port = 8776 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] osapi_volume_use_ssl = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] osapi_volume_workers = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] per_volume_size_limit = -1 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] periodic_fuzzy_delay = 60 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] periodic_interval = 60 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] public_endpoint = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] publish_errors = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] quota_backup_gigabytes = 1000 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] quota_backups = 10 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] quota_gigabytes = 1000 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] quota_groups = 10 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] quota_snapshots = 10 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] quota_volumes = 10 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] rate_limit_burst = 0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] rate_limit_except_level = CRITICAL {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] rate_limit_interval = 0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] reinit_driver_count = 3 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] replication_device = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] report_discard_supported = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] report_interval = 120 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] reservation_clean_interval = 86400 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] reservation_expire = 86400 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] reserved_image_namespaces = [] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] reserved_percentage = 0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] rpc_response_timeout = 120 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] run_external_periodic_tasks = True {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] scst_target_driver = iscsi {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] scst_target_iqn_name = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] service_down_time = 720 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] shell_completion = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] snapshot_name_template = snapshot-%s {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] split_loggers = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] state_path = /opt/stack/data/cinder {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] storage_availability_zone = nova {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] storage_protocol = iSCSI {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] syslog_log_facility = LOG_USER {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] target_helper = lioadm {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] target_ip_address = 192.168.122.48 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] target_port = 3260 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] target_protocol = iscsi {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] target_secondary_ip_addresses = [] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] trace_flags = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] transport_url = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] until_refresh = 0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] use_chap_auth = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] use_default_quota_class = True {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] use_journal = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] use_json = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] use_multipath_for_image_xfer = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] use_stderr = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] use_syslog = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] verify_glance_signatures = enabled {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] volume_api_class = cinder.volume.api.API {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] volume_backend_name = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] volume_clear = zero {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] volume_clear_ionice = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] volume_clear_size = 0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] volume_copy_bps_limit = 0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] volume_dd_blocksize = 1M {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] volume_name_template = volume-%s {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] volume_service_inithost_offload = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] volume_usage_audit_period = month {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] zoning_mode = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_concurrency.disable_process_locking = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.auth_section = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.auth_type = password {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.auth_version = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.cache = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.certfile = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.include_service_catalog = True {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.insecure = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.interface = public {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.keyfile = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.memcache_password = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.memcache_username = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.region_name = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.service_type = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.48/identity {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.backend = dogpile.cache.null {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.backend_argument = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.backend_expiration_time = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.config_prefix = cache.oslo {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.debug_cache_backend = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.enable_retry_client = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.enable_socket_keepalive = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.enabled = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.expiration_time = 600 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.hashclient_retry_attempts = 2 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.memcache_dead_retry = 300 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.memcache_pool_maxsize = 10 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.memcache_sasl_enabled = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87513) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.password = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.quobyte [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 04 15:47:42 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.quobyte [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.proxies = [] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.redis_db = 0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.redis_server = localhost:6379 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.retry_attempts = 2 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.retry_delay = 0.0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.socket_keepalive_count = 1 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.socket_keepalive_idle = 1 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.socket_keepalive_interval = 1 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.socket_timeout = 1.0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.tls_allowed_ciphers = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.tls_cafile = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.tls_certfile = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.tls_enabled = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.tls_keyfile = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cache.username = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] coordination.backend_url = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.asyncio_connection = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.asyncio_slave_connection = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.backend = sqlalchemy {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.connection = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.connection_debug = 0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Running cmd (subprocess): mount.quobyte {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.connection_parameters = {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.connection_recycle_time = 3600 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.connection_trace = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.db_inc_retry_interval = True {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.db_max_retries = 20 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.db_max_retry_interval = 10 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.db_retry_interval = 1 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.max_overflow = 50 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.max_pool_size = 5 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.max_retries = 10 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.mysql_wsrep_sync_wait = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.pool_timeout = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.retry_interval = 10 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.slave_connection = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.sqlite_synchronous = True {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.synchronous_reader = True {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] database.use_db_reconnect = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_tracing.insecure = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] profiler.connection_string = messaging:// {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] profiler.enabled = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] profiler.es_doc_type = notification {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] profiler.es_scroll_size = 10000 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] profiler.es_scroll_time = 2m {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] profiler.filter_error_trace = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] profiler.hmac_keys = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] profiler.sentinel_service_name = mymaster {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] profiler.socket_timeout = 0.1 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] profiler.trace_requests = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] profiler.trace_sqlalchemy = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] profiler_jaeger.process_tags = {} {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] profiler_jaeger.service_name_prefix = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] profiler_otlp.service_name_prefix = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_policy.enforce_new_defaults = True {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_policy.policy_default_rule = default {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_policy.policy_file = policy.yaml {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] privsep_osbrick.group = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] privsep_osbrick.helper_command = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] privsep_osbrick.user = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cinder_sys_admin.group = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cinder_sys_admin.helper_command = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] cinder_sys_admin.user = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] service_user.auth_section = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] service_user.auth_type = password {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] service_user.cafile = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] service_user.certfile = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] service_user.collect_timing = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] service_user.insecure = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] service_user.keyfile = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] service_user.send_service_user_token = True {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] service_user.split_loggers = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] service_user.timeout = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] service_user.tls_ciphers = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] service_user.tls_min_version = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance.auth_section = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance.auth_type = password {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance.certfile = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance.collect_timing = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance.insecure = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance.keyfile = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance.region_name = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance.split_loggers = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance.timeout = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance.tls_ciphers = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] glance.tls_min_version = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.backend_availability_zone = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.chap_password = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.chap_username = {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.disk_geometry = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.driver_client_cert = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.driver_client_cert_key = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.driver_data_namespace = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.driver_use_ssl = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.extra_capabilities = {} {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.filter_function = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.goodness_function = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.iscsi_target_flags = {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.iscsi_write_cache = on {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.iser_helper = tgtadm {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.iser_ip_address = 192.168.122.48 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.iser_port = 3260 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.nas_host = {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.nas_login = admin {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.nas_mount_options = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.nas_password = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.nas_private_key = {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.nas_share_path = {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.num_shell_tries = 3 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.quobyte_volume_url = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.replication_device = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack quobyte-client[87514]: Reading configuration file: /etc/quobyte/client.cfg Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.report_discard_supported = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.reserved_percentage = 0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack quobyte-client[87514]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.target_helper = tgtadm {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.target_ip_address = 192.168.122.48 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.target_port = 3260 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.target_protocol = iscsi {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.trace_flags = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.unique_fqdn_network = True {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.use_chap_auth = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] CMD "mount.quobyte" returned: 1 in 0.080s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.volume_backend_name = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.volume_clear = zero {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.volume_clear_ionice = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.volume_clear_size = 0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_reports.file_event_handler = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_reports.log_dir = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.backend_availability_zone = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.backend_host = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.chap_password = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.chap_username = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.chiscsi_conf = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.disk_geometry = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.driver_client_cert = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.driver_data_namespace = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.driver_use_ssl = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.extra_capabilities = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.filter_function = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.goodness_function = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.iser_helper = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.iser_ip_address = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.iser_port = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.iser_target_prefix = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.nas_host = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.nas_login = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.nas_mount_options = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.nas_password = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.nas_private_key = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.nas_share_path = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.nas_ssh_port = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.num_shell_tries = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.nvmet_port_id = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.replication_device = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.report_discard_supported = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.reserved_percentage = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.scst_target_driver = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.storage_protocol = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.target_helper = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.target_ip_address = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.target_port = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.target_prefix = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.target_protocol = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.trace_flags = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.use_chap_auth = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.volume_clear = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.volume_clear_size = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] QuobyteHD.volumes_dir = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.ssl = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_notifications.driver = [] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_notifications.retry = -1 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] key_manager.fixed_key = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican.barbican_api_version = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican.barbican_endpoint = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican.barbican_endpoint_type = public {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican.barbican_region_name = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican.cafile = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican.certfile = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican.collect_timing = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican.insecure = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican.keyfile = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican.number_of_retries = 60 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican.retry_delay = 1 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican.send_service_user_token = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican.split_loggers = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican.timeout = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican.tls_ciphers = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican.tls_min_version = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican.verify_ssl = True {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican.verify_ssl_path = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican_service_user.auth_section = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican_service_user.auth_type = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican_service_user.cafile = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican_service_user.certfile = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican_service_user.collect_timing = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican_service_user.insecure = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican_service_user.keyfile = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican_service_user.split_loggers = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican_service_user.timeout = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican_service_user.tls_ciphers = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] barbican_service_user.tls_min_version = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] vault.approle_role_id = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] vault.approle_secret_id = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] vault.auth_method = approle {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] vault.auth_path = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] vault.kv_mountpoint = secret {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] vault.kv_path = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] vault.kv_version = 2 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] vault.namespace = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] vault.root_token_id = **** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] vault.ssl_ca_crt_file = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] vault.timeout = 60.0 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] vault.token_file = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] vault.token_role = None {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] vault.use_ssl = False {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:42 devstack cinder-volume[87214]: DEBUG oslo_service.backend._eventlet.service [None req-ffe6081d-efc9-43a7-bdbc-4215e5d30668 None None] ******************************************************************************** {{(pid=87214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 04 15:47:43 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.231s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:47:43 devstack cinder-volume[87513]: INFO cinder.volume.driver [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Driver hasn't implemented _init_vendor_properties() Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG cinder.volume.driver [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7594451904297, 'free_capacity_gb': 1773.7594451904297, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87513) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG oslo_db.sqlalchemy.engines [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87513) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writer thread running {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG cinder.db.api [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Building query based on filter {{(pid=87513) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87513) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:47:43 devstack cinder-volume[87513]: INFO cinder.keymgr.migration [None req-88e1272d-fc1f-4ff1-8778-89f55b66a46c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 04 15:47:43 devstack sudo[87528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:47:43 devstack sudo[87528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:47:43 devstack sudo[87528]: pam_unix(sudo:session): session closed for user root Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.230s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:47:43 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Driver initialization completed successfully. Sep 04 15:47:43 devstack cinder-volume[87513]: INFO cinder.manager [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Initiating service 3 cleanup Sep 04 15:47:43 devstack cinder-volume[87513]: INFO cinder.manager [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Service 3 cleanup completed. Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG cinder.service [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Creating RPC server for service cinder-volume {{(pid=87513) start /opt/stack/cinder/cinder/service.py:231}} Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG cinder.service [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87513) start /opt/stack/cinder/cinder/service.py:237}} Sep 04 15:47:43 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:47:43 devstack sudo[87542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:47:43 devstack sudo[87542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:47:43 devstack sudo[87542]: pam_unix(sudo:session): session closed for user root Sep 04 15:47:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.231s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:47:43 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b7c96bb5-52ed-4d79-84f6-958810a2b8c1 None None] Driver post RPC initialization completed successfully. Sep 04 15:47:52 devstack cinder-volume[87214]: DEBUG dbcounter [-] [87214] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87214) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:47:53 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=2 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:47:53 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:48:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:48:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 6 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:48:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:48:43 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-13b13eef-9f08-48fa-a47a-1771c5faad8b tempest-GroupSnapshotsV319Test-80641896 None] Group tempest-GroupSnapshotsV319Test-Group-1380154899: creating Sep 04 15:48:43 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-13b13eef-9f08-48fa-a47a-1771c5faad8b tempest-GroupSnapshotsV319Test-80641896 None] Group tempest-GroupSnapshotsV319Test-Group-1380154899: created successfully Sep 04 15:48:43 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-13b13eef-9f08-48fa-a47a-1771c5faad8b tempest-GroupSnapshotsV319Test-80641896 None] Create group completed successfully. Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Flow 'volume_create_manager' (fb2eecae-c5e4-4f87-b78a-86ff62d3c824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828b1ebc-2981-48e4-bb8f-bfc2e289f3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828b1ebc-2981-48e4-bb8f-bfc2e289f3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-743349850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f896a2-cc4e-419a-a043-bd4e41d0bd6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb52fab6538e47fc9ffc673d28c43fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:48:44Z,use_quota=True,user_id='3c127d2cd5f44c99b43b9092be8fe6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0efb9b-cf64-4781-a877-aac57ae26966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0efb9b-cf64-4781-a877-aac57ae26966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce702e58-acc5-42c2-873e-2e22e29c2c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce702e58-acc5-42c2-873e-2e22e29c2c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82f896a2-cc4e-419a-a043-bd4e41d0bd6c', 'volume_name': 'volume-82f896a2-cc4e-419a-a043-bd4e41d0bd6c', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98195be0-4a36-41e9-b795-6913f6c3d35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98195be0-4a36-41e9-b795-6913f6c3d35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a46bb1-a875-4f9e-88d3-95343ad104e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:44 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Volume 82f896a2-cc4e-419a-a043-bd4e41d0bd6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82f896a2-cc4e-419a-a043-bd4e41d0bd6c', 'volume_size': 1} Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-743349850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f896a2-cc4e-419a-a043-bd4e41d0bd6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb52fab6538e47fc9ffc673d28c43fb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:48:44Z,use_quota=True,user_id='3c127d2cd5f44c99b43b9092be8fe6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Creating volume 82f896a2-cc4e-419a-a043-bd4e41d0bd6c {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:48:44 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:48:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-82f896a2-cc4e-419a-a043-bd4e41d0bd6c 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:44 devstack sudo[88069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-82f896a2-cc4e-419a-a043-bd4e41d0bd6c 1073741824 Sep 04 15:48:44 devstack sudo[88069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:45 devstack sudo[88069]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-82f896a2-cc4e-419a-a043-bd4e41d0bd6c 1073741824" returned: 0 in 0.842s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-82f896a2-cc4e-419a-a043-bd4e41d0bd6c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:45 devstack sudo[88401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-82f896a2-cc4e-419a-a043-bd4e41d0bd6c Sep 04 15:48:45 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:45 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-82f896a2-cc4e-419a-a043-bd4e41d0bd6c" returned: 0 in 0.535s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:48:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Flow 'volume_create_manager' (190a580d-9ac6-4d93-82e6-bc34586b5cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b152c9-8662-4347-91a8-4d2e1a82f10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b152c9-8662-4347-91a8-4d2e1a82f10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1670402716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=53e1d47b-be97-4bee-8a19-b6c821e116ec,host='devstack@QuobyteHD#QuobyteHD',id=598a15e2-efb8-4f06-883b-1dd864d61488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9735e1222c64a8c877850529ab6e694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:48:46Z,use_quota=True,user_id='5aeec41f3fc64525a9823ee126871028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a670c3fc-2941-4e81-afd0-33f87fffc839),volume_type_id=a670c3fc-2941-4e81-afd0-33f87fffc839)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec8b914-839a-45f0-8a94-2d1a0bc0df0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec8b914-839a-45f0-8a94-2d1a0bc0df0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67275648-de3f-47a1-8673-47d8a66e5784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67275648-de3f-47a1-8673-47d8a66e5784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '598a15e2-efb8-4f06-883b-1dd864d61488', 'volume_name': 'volume-598a15e2-efb8-4f06-883b-1dd864d61488', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b78e86-58cb-4865-9add-b9eca7b41705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b78e86-58cb-4865-9add-b9eca7b41705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dce6a06-3e26-41fe-a5be-e98b1f1b5f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:46 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Volume 598a15e2-efb8-4f06-883b-1dd864d61488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-598a15e2-efb8-4f06-883b-1dd864d61488', 'volume_size': 1} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=53e1d47b-be97-4bee-8a19-b6c821e116ec,created_at=2026-09-04T13:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1670402716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=53e1d47b-be97-4bee-8a19-b6c821e116ec,host='devstack@QuobyteHD#QuobyteHD',id=598a15e2-efb8-4f06-883b-1dd864d61488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9735e1222c64a8c877850529ab6e694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:48:46Z,use_quota=True,user_id='5aeec41f3fc64525a9823ee126871028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a670c3fc-2941-4e81-afd0-33f87fffc839),volume_type_id=a670c3fc-2941-4e81-afd0-33f87fffc839)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Creating volume 598a15e2-efb8-4f06-883b-1dd864d61488 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:48:46 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a46bb1-a875-4f9e-88d3-95343ad104e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f896a2-cc4e-419a-a043-bd4e41d0bd6c', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5e03b6-cd64-4235-9a34-223b8784c846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:46 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Volume volume-82f896a2-cc4e-419a-a043-bd4e41d0bd6c (82f896a2-cc4e-419a-a043-bd4e41d0bd6c): created successfully Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5e03b6-cd64-4235-9a34-223b8784c846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:46 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488 1073741824 Sep 04 15:48:46 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Flow 'volume_create_manager' (fb2eecae-c5e4-4f87-b78a-86ff62d3c824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:48:46 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-a14b0f60-85ec-4546-909e-f84ff734fc24 tempest-DeleteServersTestJSON-1212242946 None] Created volume successfully. Sep 04 15:48:46 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488 1073741824" returned: 0 in 0.592s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:46 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488 Sep 04 15:48:46 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:47 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488" returned: 0 in 0.348s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:48:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:48:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dce6a06-3e26-41fe-a5be-e98b1f1b5f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-598a15e2-efb8-4f06-883b-1dd864d61488', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859b0166-1da3-4315-8c94-6feab416e407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:47 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Volume volume-598a15e2-efb8-4f06-883b-1dd864d61488 (598a15e2-efb8-4f06-883b-1dd864d61488): created successfully Sep 04 15:48:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859b0166-1da3-4315-8c94-6feab416e407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Flow 'volume_create_manager' (190a580d-9ac6-4d93-82e6-bc34586b5cda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:48:47 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-3183cacf-ba35-463c-801c-1b291b012342 tempest-GroupSnapshotsV319Test-80641896 None] Created volume successfully. Sep 04 15:48:48 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] GroupSnapshot b5ef89f1-9174-4e89-9327-c65578807000: creating. Sep 04 15:48:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] Group snapshot b5ef89f1-9174-4e89-9327-c65578807000: creating. {{(pid=87513) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 15:48:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:48:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:48:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] Creating offline snapshot 8d94a8de-f0a1-4aac-9019-a0259353fc35 of volume 598a15e2-efb8-4f06-883b-1dd864d61488 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:48:48 devstack cinder-volume[87513]: INFO oslo.privsep.daemon [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpiyx402_1/privsep.sock'] Sep 04 15:48:48 devstack sudo[88454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpiyx402_1/privsep.sock Sep 04 15:48:48 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:50 devstack cinder-volume[87513]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 04 15:48:50 devstack cinder-volume[87513]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 15:48:50 devstack cinder-volume[87513]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 04 15:48:50 devstack cinder-volume[87513]: WARNING oslo.privsep.daemon [-] privsep log: Sep 04 15:48:50 devstack cinder-volume[87513]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 04 15:48:50 devstack cinder-volume[87513]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 04 15:48:50 devstack cinder-volume[87513]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 15:48:50 devstack cinder-volume[87513]: WARNING oslo.privsep.daemon [-] privsep log: Sep 04 15:48:50 devstack cinder-volume[87513]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 04 15:48:50 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:50 devstack cinder-volume[87513]: INFO oslo.privsep.daemon [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] Spawned new privsep daemon via rootwrap Sep 04 15:48:50 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] Accepted privsep connection to /tmp/tmpiyx402_1/privsep.sock {{(pid=87513) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 04 15:48:50 devstack cinder-volume[87513]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 04 15:48:50 devstack cinder-volume[87513]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 04 15:48:50 devstack cinder-volume[87513]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 04 15:48:50 devstack cinder-volume[87513]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88475 Sep 04 15:48:50 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c17aa1-2675-4365-8d3b-aa9aecae2d04]: (2,) {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:48:50 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[833d194a-c403-4397-b58d-11deca77bf68]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:48:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:50 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488 Sep 04 15:48:50 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:51 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488" returned: 0 in 0.647s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.8d94a8de-f0a1-4aac-9019-a0259353fc35 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:51 devstack sudo[88483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.8d94a8de-f0a1-4aac-9019-a0259353fc35 1G Sep 04 15:48:51 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:51 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.8d94a8de-f0a1-4aac-9019-a0259353fc35 1G" returned: 0 in 0.774s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-598a15e2-efb8-4f06-883b-1dd864d61488 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.8d94a8de-f0a1-4aac-9019-a0259353fc35 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:51 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-598a15e2-efb8-4f06-883b-1dd864d61488 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.8d94a8de-f0a1-4aac-9019-a0259353fc35 Sep 04 15:48:51 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:52 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-598a15e2-efb8-4f06-883b-1dd864d61488 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.8d94a8de-f0a1-4aac-9019-a0259353fc35" returned: 0 in 0.580s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:52 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.8d94a8de-f0a1-4aac-9019-a0259353fc35 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 15:48:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.8d94a8de-f0a1-4aac-9019-a0259353fc35 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:52 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.8d94a8de-f0a1-4aac-9019-a0259353fc35 Sep 04 15:48:52 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:52 devstack cinder-volume[87513]: WARNING py.warnings [req-a6435143-2cee-43f3-9493-be58c50fc0c9 req-d7971521-a00a-43ab-bfdb-d533fc8a699b tempest-DeleteServersTestJSON-1212242946 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 04 15:48:52 devstack cinder-volume[87513]: .first() Sep 04 15:48:52 devstack cinder-volume[87513]: Sep 04 15:48:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-a6435143-2cee-43f3-9493-be58c50fc0c9 req-d7971521-a00a-43ab-bfdb-d533fc8a699b tempest-DeleteServersTestJSON-1212242946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:48:52 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.8d94a8de-f0a1-4aac-9019-a0259353fc35" returned: 0 in 0.423s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:52 devstack sudo[88540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.info Sep 04 15:48:52 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:53 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.info" returned: 0 in 0.582s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:53 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 15:48:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:53 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.info Sep 04 15:48:53 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:53 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.info" returned: 0 in 0.455s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.806s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:48:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-a6435143-2cee-43f3-9493-be58c50fc0c9 req-d7971521-a00a-43ab-bfdb-d533fc8a699b tempest-DeleteServersTestJSON-1212242946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.412s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:48:54 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a75c50-cef6-47de-9cd7-5d0cb159b2a9]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:48:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-a6435143-2cee-43f3-9493-be58c50fc0c9 req-d7971521-a00a-43ab-bfdb-d533fc8a699b tempest-DeleteServersTestJSON-1212242946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-82f896a2-cc4e-419a-a043-bd4e41d0bd6c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:54 devstack sudo[88615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-82f896a2-cc4e-419a-a043-bd4e41d0bd6c Sep 04 15:48:54 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:54 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-a9f61586-9596-4dea-b5d1-440df9333c38 tempest-GroupSnapshotsV319Test-80641896 None] group_snapshot b5ef89f1-9174-4e89-9327-c65578807000: created successfully Sep 04 15:48:54 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-a6435143-2cee-43f3-9493-be58c50fc0c9 req-d7971521-a00a-43ab-bfdb-d533fc8a699b tempest-DeleteServersTestJSON-1212242946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-82f896a2-cc4e-419a-a043-bd4e41d0bd6c" returned: 0 in 0.607s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-a6435143-2cee-43f3-9493-be58c50fc0c9 req-d7971521-a00a-43ab-bfdb-d533fc8a699b tempest-DeleteServersTestJSON-1212242946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.637s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:48:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-a6435143-2cee-43f3-9493-be58c50fc0c9 req-d7971521-a00a-43ab-bfdb-d533fc8a699b tempest-DeleteServersTestJSON-1212242946 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-82f896a2-cc4e-419a-a043-bd4e41d0bd6c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9de279e6-74f9-4cb7-a5eb-c6b8f832bac5', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:48:54 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-a6435143-2cee-43f3-9493-be58c50fc0c9 req-d7971521-a00a-43ab-bfdb-d533fc8a699b tempest-DeleteServersTestJSON-1212242946 None] attachment_update completed successfully. Sep 04 15:48:55 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] group_snapshot b5ef89f1-9174-4e89-9327-c65578807000: deleting Sep 04 15:48:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] group_snapshot b5ef89f1-9174-4e89-9327-c65578807000: deleting {{(pid=87513) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 15:48:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] Acquiring lock "cinder-quobyte-598a15e2-efb8-4f06-883b-1dd864d61488" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:48:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] Lock "cinder-quobyte-598a15e2-efb8-4f06-883b-1dd864d61488" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:48:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] Acquiring lock "cinder-quobyte-8d94a8de-f0a1-4aac-9019-a0259353fc35" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:48:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] Lock "cinder-quobyte-8d94a8de-f0a1-4aac-9019-a0259353fc35" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:48:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] Deleting offline snapshot 8d94a8de-f0a1-4aac-9019-a0259353fc35 of volume 598a15e2-efb8-4f06-883b-1dd864d61488 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:48:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] snapshot_file for this snap is: volume-598a15e2-efb8-4f06-883b-1dd864d61488.8d94a8de-f0a1-4aac-9019-a0259353fc35 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:48:55 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[474e9657-34b0-4a0d-9e0a-a459d739dbe7]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:48:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.8d94a8de-f0a1-4aac-9019-a0259353fc35 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:56 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.8d94a8de-f0a1-4aac-9019-a0259353fc35 Sep 04 15:48:56 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:56 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.8d94a8de-f0a1-4aac-9019-a0259353fc35" returned: 0 in 0.873s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-598a15e2-efb8-4f06-883b-1dd864d61488(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:48:56 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[307eb7fe-22c2-4785-9e56-623daf4be897]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:48:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:57 devstack sudo[89064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488 Sep 04 15:48:57 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:57 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488" returned: 0 in 0.521s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.8d94a8de-f0a1-4aac-9019-a0259353fc35 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:57 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.8d94a8de-f0a1-4aac-9019-a0259353fc35 Sep 04 15:48:57 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:58 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.8d94a8de-f0a1-4aac-9019-a0259353fc35" returned: 0 in 0.692s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.8d94a8de-f0a1-4aac-9019-a0259353fc35 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:58 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.8d94a8de-f0a1-4aac-9019-a0259353fc35 Sep 04 15:48:58 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Flow 'volume_create_manager' (b17a5942-1049-4b6d-9c43-7c6ca32db3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7937871-0e68-4955-8774-3dfae28a2295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7937871-0e68-4955-8774-3dfae28a2295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-332139062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92c54ae-9be3-4753-9f92-3635731f0cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c61eb82bd3e4633abad40877cb4a45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:48:58Z,use_quota=True,user_id='299489c99abc4a8eaf24b2f5577a68cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5977d369-45ef-413f-b418-2c08a1eaf830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5977d369-45ef-413f-b418-2c08a1eaf830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c363b11f-486c-4aa2-a346-0349010f6772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c363b11f-486c-4aa2-a346-0349010f6772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e92c54ae-9be3-4753-9f92-3635731f0cce', 'volume_name': 'volume-e92c54ae-9be3-4753-9f92-3635731f0cce', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a8cb29-9440-4446-93ce-959d8a3de575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a8cb29-9440-4446-93ce-959d8a3de575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fef9899-e637-4f75-93fb-63bcac012271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:58 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Volume e92c54ae-9be3-4753-9f92-3635731f0cce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e92c54ae-9be3-4753-9f92-3635731f0cce', 'volume_size': 1} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-332139062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92c54ae-9be3-4753-9f92-3635731f0cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c61eb82bd3e4633abad40877cb4a45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:48:58Z,use_quota=True,user_id='299489c99abc4a8eaf24b2f5577a68cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Creating volume e92c54ae-9be3-4753-9f92-3635731f0cce {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:48:58 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e92c54ae-9be3-4753-9f92-3635731f0cce 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:58 devstack sudo[89079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e92c54ae-9be3-4753-9f92-3635731f0cce 1073741824 Sep 04 15:48:58 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:58 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488.8d94a8de-f0a1-4aac-9019-a0259353fc35" returned: 0 in 0.635s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] Lock "cinder-quobyte-8d94a8de-f0a1-4aac-9019-a0259353fc35" released by "_delete_snapshot" :: held 2.972s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:48:58 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] Lock "cinder-quobyte-598a15e2-efb8-4f06-883b-1dd864d61488" released by "delete_snapshot" :: held 3.015s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:48:59 devstack cinder-volume[87513]: WARNING cinder.quota [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2060639187 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2060639187, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:48:59 devstack cinder-volume[87513]: WARNING cinder.quota [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2060639187 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2060639187, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:48:59 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e92c54ae-9be3-4753-9f92-3635731f0cce 1073741824" returned: 0 in 0.913s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:59 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] Created reservations ['4f74cf28-acc0-4a57-a815-e9edcd23ecc9', '18d13fe0-73f6-44a4-b9dd-2863bb3d9803', '5883068c-ca1d-4e90-96a5-b5214c2d5694', '04c3b8c6-e858-4200-a6f8-2f940aa3b707'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:48:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e92c54ae-9be3-4753-9f92-3635731f0cce {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:59 devstack sudo[89131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e92c54ae-9be3-4753-9f92-3635731f0cce Sep 04 15:48:59 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:59 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-560dea67-e242-4502-a981-43a2acb0063e tempest-GroupSnapshotsV319Test-80641896 None] group_snapshot b5ef89f1-9174-4e89-9327-c65578807000: deleted successfully Sep 04 15:48:59 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e92c54ae-9be3-4753-9f92-3635731f0cce" returned: 0 in 0.312s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:48:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:48:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fef9899-e637-4f75-93fb-63bcac012271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e92c54ae-9be3-4753-9f92-3635731f0cce', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3bc86a-8421-4c50-b86c-e301def29ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:59 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Volume volume-e92c54ae-9be3-4753-9f92-3635731f0cce (e92c54ae-9be3-4753-9f92-3635731f0cce): created successfully Sep 04 15:48:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3bc86a-8421-4c50-b86c-e301def29ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Flow 'volume_create_manager' (b17a5942-1049-4b6d-9c43-7c6ca32db3d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:48:59 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-c9ea3d73-a517-4585-8062-bdb79044cf57 tempest-VolumesAdminNegativeTest-964058230 None] Created volume successfully. Sep 04 15:49:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e606bcb5-a846-465e-98f8-d38ab2cdd81a tempest-GroupSnapshotsV319Test-80641896 None] Acquiring lock "cinder-quobyte-598a15e2-efb8-4f06-883b-1dd864d61488" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:49:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e606bcb5-a846-465e-98f8-d38ab2cdd81a tempest-GroupSnapshotsV319Test-80641896 None] Lock "cinder-quobyte-598a15e2-efb8-4f06-883b-1dd864d61488" acquired by "delete_volume" :: waited 0.049s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:49:00 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[13312c5f-8bc9-4de5-9266-96cecadfb466]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:49:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e606bcb5-a846-465e-98f8-d38ab2cdd81a tempest-GroupSnapshotsV319Test-80641896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:00 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488 Sep 04 15:49:00 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:01 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-e698af86-2023-403f-820c-ec900efd316e req-34094334-cb91-49d2-ad47-df5ec63abd62 tempest-DeleteServersTestJSON-1212242946 None] Terminate volume connection completed successfully. Sep 04 15:49:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-e698af86-2023-403f-820c-ec900efd316e req-34094334-cb91-49d2-ad47-df5ec63abd62 tempest-DeleteServersTestJSON-1212242946 None] Deleting attachment 9de279e6-74f9-4cb7-a5eb-c6b8f832bac5. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:49:01 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e606bcb5-a846-465e-98f8-d38ab2cdd81a tempest-GroupSnapshotsV319Test-80641896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488" returned: 0 in 0.718s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e606bcb5-a846-465e-98f8-d38ab2cdd81a tempest-GroupSnapshotsV319Test-80641896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:01 devstack sudo[89144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488 Sep 04 15:49:01 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] Acquiring lock "cinder-e92c54ae-9be3-4753-9f92-3635731f0cce-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:49:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] Lock "cinder-e92c54ae-9be3-4753-9f92-3635731f0cce-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:49:01 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e606bcb5-a846-465e-98f8-d38ab2cdd81a tempest-GroupSnapshotsV319Test-80641896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-598a15e2-efb8-4f06-883b-1dd864d61488" returned: 0 in 0.459s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e606bcb5-a846-465e-98f8-d38ab2cdd81a tempest-GroupSnapshotsV319Test-80641896 None] Lock "cinder-quobyte-598a15e2-efb8-4f06-883b-1dd864d61488" released by "delete_volume" :: held 1.307s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:49:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] Acquiring lock "cinder-quobyte-e92c54ae-9be3-4753-9f92-3635731f0cce" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:49:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] Lock "cinder-quobyte-e92c54ae-9be3-4753-9f92-3635731f0cce" acquired by "delete_volume" :: waited 0.045s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:49:01 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20599d0-8a84-4afc-a27e-defdfd9b71d5]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:49:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e92c54ae-9be3-4753-9f92-3635731f0cce {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:01 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-e606bcb5-a846-465e-98f8-d38ab2cdd81a tempest-GroupSnapshotsV319Test-80641896 None] Created reservations ['79b17892-f600-45a5-9504-70d872c95879'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:49:02 devstack cinder-volume[87513]: WARNING cinder.quota [None req-e606bcb5-a846-465e-98f8-d38ab2cdd81a tempest-GroupSnapshotsV319Test-80641896 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2060639187 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2060639187, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:49:02 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e92c54ae-9be3-4753-9f92-3635731f0cce Sep 04 15:49:02 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:02 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-e606bcb5-a846-465e-98f8-d38ab2cdd81a tempest-GroupSnapshotsV319Test-80641896 None] Created reservations ['515bac60-0092-4116-9003-9ac523e2d2b3', '71eb0434-8391-4238-99e8-65850a020fc5', 'f328b392-b325-47b8-abc7-3a86e292552a', '77fbbc56-bd57-4b5b-9c47-1076c3fc9000'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:49:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e606bcb5-a846-465e-98f8-d38ab2cdd81a tempest-GroupSnapshotsV319Test-80641896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e606bcb5-a846-465e-98f8-d38ab2cdd81a tempest-GroupSnapshotsV319Test-80641896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e606bcb5-a846-465e-98f8-d38ab2cdd81a tempest-GroupSnapshotsV319Test-80641896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:49:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e606bcb5-a846-465e-98f8-d38ab2cdd81a tempest-GroupSnapshotsV319Test-80641896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:49:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e606bcb5-a846-465e-98f8-d38ab2cdd81a tempest-GroupSnapshotsV319Test-80641896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e606bcb5-a846-465e-98f8-d38ab2cdd81a tempest-GroupSnapshotsV319Test-80641896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:02 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e92c54ae-9be3-4753-9f92-3635731f0cce" returned: 0 in 0.534s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e92c54ae-9be3-4753-9f92-3635731f0cce {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:02 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:49:02 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:02 devstack sudo[89155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e92c54ae-9be3-4753-9f92-3635731f0cce Sep 04 15:49:02 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:02 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e606bcb5-a846-465e-98f8-d38ab2cdd81a tempest-GroupSnapshotsV319Test-80641896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.470s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:02 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-e606bcb5-a846-465e-98f8-d38ab2cdd81a tempest-GroupSnapshotsV319Test-80641896 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:49:02 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e606bcb5-a846-465e-98f8-d38ab2cdd81a tempest-GroupSnapshotsV319Test-80641896 None] Delete group completed successfully. Sep 04 15:49:02 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e92c54ae-9be3-4753-9f92-3635731f0cce" returned: 0 in 0.482s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:02 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] Lock "cinder-quobyte-e92c54ae-9be3-4753-9f92-3635731f0cce" released by "delete_volume" :: held 1.081s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:49:02 devstack cinder-volume[87513]: WARNING cinder.quota [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:49:02 devstack cinder-volume[87513]: WARNING cinder.quota [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:49:03 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] Created reservations ['2b114ffe-7c6c-4b48-9a49-c8dd77e5004e', '86164e75-2f23-4733-a004-4e4e84b2f80e', 'd3cfb9b0-2357-45a5-afc3-fd25a7efa7ac', 'c6413110-b77a-4db7-b658-0d1d5d86177b'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:49:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:49:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:49:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:03 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:49:03 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:03 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.342s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:03 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:49:03 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] Deleted volume successfully. Sep 04 15:49:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4f802521-495b-43ae-a8ca-6362f8ca6d21 tempest-VolumesAdminNegativeTest-964058230 None] Lock "cinder-e92c54ae-9be3-4753-9f92-3635731f0cce-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:49:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-71cf5f47-6613-4ed9-8558-0c70691bbfab tempest-DeleteServersTestJSON-1212242946 None] Acquiring lock "cinder-82f896a2-cc4e-419a-a043-bd4e41d0bd6c-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:49:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-71cf5f47-6613-4ed9-8558-0c70691bbfab tempest-DeleteServersTestJSON-1212242946 None] Lock "cinder-82f896a2-cc4e-419a-a043-bd4e41d0bd6c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:49:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-71cf5f47-6613-4ed9-8558-0c70691bbfab tempest-DeleteServersTestJSON-1212242946 None] Acquiring lock "cinder-quobyte-82f896a2-cc4e-419a-a043-bd4e41d0bd6c" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:49:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-71cf5f47-6613-4ed9-8558-0c70691bbfab tempest-DeleteServersTestJSON-1212242946 None] Lock "cinder-quobyte-82f896a2-cc4e-419a-a043-bd4e41d0bd6c" acquired by "delete_volume" :: waited 0.022s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:49:04 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8912db82-fbe3-424d-9490-7dae4ce390ac]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:49:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-71cf5f47-6613-4ed9-8558-0c70691bbfab tempest-DeleteServersTestJSON-1212242946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-82f896a2-cc4e-419a-a043-bd4e41d0bd6c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:04 devstack sudo[89164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-82f896a2-cc4e-419a-a043-bd4e41d0bd6c Sep 04 15:49:04 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:04 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-71cf5f47-6613-4ed9-8558-0c70691bbfab tempest-DeleteServersTestJSON-1212242946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-82f896a2-cc4e-419a-a043-bd4e41d0bd6c" returned: 0 in 0.601s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-71cf5f47-6613-4ed9-8558-0c70691bbfab tempest-DeleteServersTestJSON-1212242946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-82f896a2-cc4e-419a-a043-bd4e41d0bd6c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:04 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-82f896a2-cc4e-419a-a043-bd4e41d0bd6c Sep 04 15:49:04 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:05 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-71cf5f47-6613-4ed9-8558-0c70691bbfab tempest-DeleteServersTestJSON-1212242946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-82f896a2-cc4e-419a-a043-bd4e41d0bd6c" returned: 0 in 0.512s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-71cf5f47-6613-4ed9-8558-0c70691bbfab tempest-DeleteServersTestJSON-1212242946 None] Lock "cinder-quobyte-82f896a2-cc4e-419a-a043-bd4e41d0bd6c" released by "delete_volume" :: held 1.172s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:49:05 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-71cf5f47-6613-4ed9-8558-0c70691bbfab tempest-DeleteServersTestJSON-1212242946 None] Created reservations ['bf4d89e5-1a25-41dc-a7de-66f42b7dc539', 'ea3c366f-fab9-4566-8023-4559e49a064d', '0c8ba27f-1c5d-4a3e-bbce-cd1a2f03c9fd', '6afa7a24-10fe-4136-ab92-fcd35e304b4b'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:49:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-71cf5f47-6613-4ed9-8558-0c70691bbfab tempest-DeleteServersTestJSON-1212242946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-71cf5f47-6613-4ed9-8558-0c70691bbfab tempest-DeleteServersTestJSON-1212242946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-71cf5f47-6613-4ed9-8558-0c70691bbfab tempest-DeleteServersTestJSON-1212242946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:49:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-71cf5f47-6613-4ed9-8558-0c70691bbfab tempest-DeleteServersTestJSON-1212242946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:49:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-71cf5f47-6613-4ed9-8558-0c70691bbfab tempest-DeleteServersTestJSON-1212242946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-71cf5f47-6613-4ed9-8558-0c70691bbfab tempest-DeleteServersTestJSON-1212242946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:05 devstack sudo[89195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:49:05 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:05 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-71cf5f47-6613-4ed9-8558-0c70691bbfab tempest-DeleteServersTestJSON-1212242946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.275s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:05 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-71cf5f47-6613-4ed9-8558-0c70691bbfab tempest-DeleteServersTestJSON-1212242946 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:49:05 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-71cf5f47-6613-4ed9-8558-0c70691bbfab tempest-DeleteServersTestJSON-1212242946 None] Deleted volume successfully. Sep 04 15:49:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-71cf5f47-6613-4ed9-8558-0c70691bbfab tempest-DeleteServersTestJSON-1212242946 None] Lock "cinder-82f896a2-cc4e-419a-a043-bd4e41d0bd6c-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:49:11 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-486d73a0-3506-4c14-a795-05c847e0b0d0 tempest-GroupsTest-1312198782 None] Group tempest-Group1-1612373403: creating Sep 04 15:49:11 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-486d73a0-3506-4c14-a795-05c847e0b0d0 tempest-GroupsTest-1312198782 None] Group tempest-Group1-1612373403: created successfully Sep 04 15:49:11 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-486d73a0-3506-4c14-a795-05c847e0b0d0 tempest-GroupsTest-1312198782 None] Create group completed successfully. Sep 04 15:49:12 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-6560fdc8-73c3-49a5-9a8c-029f509ca771 tempest-GroupsTest-1312198782 None] Group tempest-Group2-1255767302: creating Sep 04 15:49:12 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-6560fdc8-73c3-49a5-9a8c-029f509ca771 tempest-GroupsTest-1312198782 None] Group tempest-Group2-1255767302: created successfully Sep 04 15:49:12 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-6560fdc8-73c3-49a5-9a8c-029f509ca771 tempest-GroupsTest-1312198782 None] Create group completed successfully. Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Flow 'volume_create_manager' (b3a65b02-140f-43a4-a039-366097a431af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab776b3b-726e-48c7-8f13-613c60d88dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab776b3b-726e-48c7-8f13-613c60d88dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1333706430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77355902-de5e-4c87-8db4-9e935e87feaa,host='devstack@QuobyteHD#QuobyteHD',id=61cd20e0-9623-42cc-87bf-6d2b4d02c2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a2dacf37e646b6a7c54d02e17316b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:49:14Z,use_quota=True,user_id='d58fe38d2de443f79e0dfa9499824506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e873db50-6ae2-43ab-9e90-e2d38cfa2175),volume_type_id=e873db50-6ae2-43ab-9e90-e2d38cfa2175)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166223fc-0053-432b-8c38-22c040eda39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166223fc-0053-432b-8c38-22c040eda39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3cf898-63ee-4784-b6ae-ec841756a8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3cf898-63ee-4784-b6ae-ec841756a8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61cd20e0-9623-42cc-87bf-6d2b4d02c2fc', 'volume_name': 'volume-61cd20e0-9623-42cc-87bf-6d2b4d02c2fc', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b890abc9-2ddf-4069-9a50-14b59ba3286e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b890abc9-2ddf-4069-9a50-14b59ba3286e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee9e1e1-0261-4659-8267-f66b209ba34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:14 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Volume 61cd20e0-9623-42cc-87bf-6d2b4d02c2fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61cd20e0-9623-42cc-87bf-6d2b4d02c2fc', 'volume_size': 1} Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=77355902-de5e-4c87-8db4-9e935e87feaa,created_at=2026-09-04T13:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1333706430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77355902-de5e-4c87-8db4-9e935e87feaa,host='devstack@QuobyteHD#QuobyteHD',id=61cd20e0-9623-42cc-87bf-6d2b4d02c2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a2dacf37e646b6a7c54d02e17316b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:49:14Z,use_quota=True,user_id='d58fe38d2de443f79e0dfa9499824506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e873db50-6ae2-43ab-9e90-e2d38cfa2175),volume_type_id=e873db50-6ae2-43ab-9e90-e2d38cfa2175)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Creating volume 61cd20e0-9623-42cc-87bf-6d2b4d02c2fc {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:49:14 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:49:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-61cd20e0-9623-42cc-87bf-6d2b4d02c2fc 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:14 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-61cd20e0-9623-42cc-87bf-6d2b4d02c2fc 1073741824 Sep 04 15:49:14 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:15 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-61cd20e0-9623-42cc-87bf-6d2b4d02c2fc 1073741824" returned: 0 in 0.533s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-61cd20e0-9623-42cc-87bf-6d2b4d02c2fc {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:15 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-61cd20e0-9623-42cc-87bf-6d2b4d02c2fc Sep 04 15:49:15 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:15 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-61cd20e0-9623-42cc-87bf-6d2b4d02c2fc" returned: 0 in 0.263s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:49:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee9e1e1-0261-4659-8267-f66b209ba34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61cd20e0-9623-42cc-87bf-6d2b4d02c2fc', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec285fc5-b0d4-45af-9282-aa37025df514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:15 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Volume volume-61cd20e0-9623-42cc-87bf-6d2b4d02c2fc (61cd20e0-9623-42cc-87bf-6d2b4d02c2fc): created successfully Sep 04 15:49:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec285fc5-b0d4-45af-9282-aa37025df514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Flow 'volume_create_manager' (b3a65b02-140f-43a4-a039-366097a431af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:49:15 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ee5921a7-66be-44ba-9e36-335ed2a821d3 tempest-GroupsTest-1312198782 None] Created volume successfully. Sep 04 15:49:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-46eb113c-2207-40b2-bedc-99197e72d35e tempest-GroupsTest-1312198782 None] Acquiring lock "cinder-quobyte-61cd20e0-9623-42cc-87bf-6d2b4d02c2fc" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:49:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-46eb113c-2207-40b2-bedc-99197e72d35e tempest-GroupsTest-1312198782 None] Lock "cinder-quobyte-61cd20e0-9623-42cc-87bf-6d2b4d02c2fc" acquired by "delete_volume" :: waited 0.035s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:49:17 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[4675f555-9e21-4e02-9909-07bdccdb649a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:49:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-46eb113c-2207-40b2-bedc-99197e72d35e tempest-GroupsTest-1312198782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-61cd20e0-9623-42cc-87bf-6d2b4d02c2fc {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:17 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-61cd20e0-9623-42cc-87bf-6d2b4d02c2fc Sep 04 15:49:17 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:18 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-46eb113c-2207-40b2-bedc-99197e72d35e tempest-GroupsTest-1312198782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-61cd20e0-9623-42cc-87bf-6d2b4d02c2fc" returned: 0 in 0.414s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-46eb113c-2207-40b2-bedc-99197e72d35e tempest-GroupsTest-1312198782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-61cd20e0-9623-42cc-87bf-6d2b4d02c2fc {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:18 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-61cd20e0-9623-42cc-87bf-6d2b4d02c2fc Sep 04 15:49:18 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:18 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-46eb113c-2207-40b2-bedc-99197e72d35e tempest-GroupsTest-1312198782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-61cd20e0-9623-42cc-87bf-6d2b4d02c2fc" returned: 0 in 0.252s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:18 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-46eb113c-2207-40b2-bedc-99197e72d35e tempest-GroupsTest-1312198782 None] Lock "cinder-quobyte-61cd20e0-9623-42cc-87bf-6d2b4d02c2fc" released by "delete_volume" :: held 0.727s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:49:18 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-46eb113c-2207-40b2-bedc-99197e72d35e tempest-GroupsTest-1312198782 None] Created reservations ['2b09244a-5ea6-421e-9c09-e81945fec8fc'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:49:18 devstack cinder-volume[87513]: WARNING cinder.quota [None req-46eb113c-2207-40b2-bedc-99197e72d35e tempest-GroupsTest-1312198782 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-287171556 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-287171556, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:49:18 devstack cinder-volume[87513]: WARNING cinder.quota [None req-46eb113c-2207-40b2-bedc-99197e72d35e tempest-GroupsTest-1312198782 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-287171556 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-287171556, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:49:18 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-46eb113c-2207-40b2-bedc-99197e72d35e tempest-GroupsTest-1312198782 None] Created reservations ['77f9b458-2b5a-45fa-ab8f-2210e19df103', '3a8a5276-d12c-4d48-9881-fe5664cf9b33', 'a20fa32a-951b-4a57-8e21-d37b834f7fb2', 'd2c6ec43-9aff-4c0d-a312-a57d58a96db4'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:49:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-46eb113c-2207-40b2-bedc-99197e72d35e tempest-GroupsTest-1312198782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-46eb113c-2207-40b2-bedc-99197e72d35e tempest-GroupsTest-1312198782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:18 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-46eb113c-2207-40b2-bedc-99197e72d35e tempest-GroupsTest-1312198782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:49:18 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-46eb113c-2207-40b2-bedc-99197e72d35e tempest-GroupsTest-1312198782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:49:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-46eb113c-2207-40b2-bedc-99197e72d35e tempest-GroupsTest-1312198782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-46eb113c-2207-40b2-bedc-99197e72d35e tempest-GroupsTest-1312198782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:18 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:49:18 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:18 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-46eb113c-2207-40b2-bedc-99197e72d35e tempest-GroupsTest-1312198782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.314s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:18 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-46eb113c-2207-40b2-bedc-99197e72d35e tempest-GroupsTest-1312198782 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:49:18 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-46eb113c-2207-40b2-bedc-99197e72d35e tempest-GroupsTest-1312198782 None] Delete group completed successfully. Sep 04 15:49:19 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-f6bb0b8c-901c-430f-845d-0f433f43141e tempest-GroupsTest-1312198782 None] Created reservations ['95f71640-0ac6-4975-a7f9-c8c56f8052af'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:49:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f6bb0b8c-901c-430f-845d-0f433f43141e tempest-GroupsTest-1312198782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f6bb0b8c-901c-430f-845d-0f433f43141e tempest-GroupsTest-1312198782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f6bb0b8c-901c-430f-845d-0f433f43141e tempest-GroupsTest-1312198782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:49:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f6bb0b8c-901c-430f-845d-0f433f43141e tempest-GroupsTest-1312198782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:49:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f6bb0b8c-901c-430f-845d-0f433f43141e tempest-GroupsTest-1312198782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f6bb0b8c-901c-430f-845d-0f433f43141e tempest-GroupsTest-1312198782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:19 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:49:19 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:19 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f6bb0b8c-901c-430f-845d-0f433f43141e tempest-GroupsTest-1312198782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.271s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:19 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-f6bb0b8c-901c-430f-845d-0f433f43141e tempest-GroupsTest-1312198782 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:49:19 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-f6bb0b8c-901c-430f-845d-0f433f43141e tempest-GroupsTest-1312198782 None] Delete group completed successfully. Sep 04 15:49:20 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-1750b60c-ddeb-4978-8b54-bba572969f2f tempest-GroupsTest-1312198782 None] Group tempest-GroupsTest-Group-556230989: creating Sep 04 15:49:20 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-1750b60c-ddeb-4978-8b54-bba572969f2f tempest-GroupsTest-1312198782 None] Group tempest-GroupsTest-Group-556230989: created successfully Sep 04 15:49:20 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-1750b60c-ddeb-4978-8b54-bba572969f2f tempest-GroupsTest-1312198782 None] Create group completed successfully. Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Flow 'volume_create_manager' (b96d9296-3f55-48cb-9c4c-b6062e8a9d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ed94c5-fa3f-4382-a0b2-2172316a90e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ed94c5-fa3f-4382-a0b2-2172316a90e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-331843072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c249c6a2-8065-40af-81db-8ca68a6759d2,host='devstack@QuobyteHD#QuobyteHD',id=a7d9a02f-acf3-449b-b631-36af76c24ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a2dacf37e646b6a7c54d02e17316b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:49:23Z,use_quota=True,user_id='d58fe38d2de443f79e0dfa9499824506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f1c2865-4d49-41f4-87ba-c1badbb184ea),volume_type_id=6f1c2865-4d49-41f4-87ba-c1badbb184ea)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96deaf1c-7e93-49db-a5fe-1c86235c1152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96deaf1c-7e93-49db-a5fe-1c86235c1152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9fdcaca-5d5a-40d7-a6af-a1810c8cd2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9fdcaca-5d5a-40d7-a6af-a1810c8cd2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7d9a02f-acf3-449b-b631-36af76c24ae7', 'volume_name': 'volume-a7d9a02f-acf3-449b-b631-36af76c24ae7', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab010e2-b57b-4d94-b579-837d19d964ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab010e2-b57b-4d94-b579-837d19d964ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a50a670-e1a1-425d-b268-be9c7a1c8805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:22 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Volume a7d9a02f-acf3-449b-b631-36af76c24ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7d9a02f-acf3-449b-b631-36af76c24ae7', 'volume_size': 1} Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c249c6a2-8065-40af-81db-8ca68a6759d2,created_at=2026-09-04T13:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-331843072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c249c6a2-8065-40af-81db-8ca68a6759d2,host='devstack@QuobyteHD#QuobyteHD',id=a7d9a02f-acf3-449b-b631-36af76c24ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a2dacf37e646b6a7c54d02e17316b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:49:23Z,use_quota=True,user_id='d58fe38d2de443f79e0dfa9499824506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f1c2865-4d49-41f4-87ba-c1badbb184ea),volume_type_id=6f1c2865-4d49-41f4-87ba-c1badbb184ea)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Creating volume a7d9a02f-acf3-449b-b631-36af76c24ae7 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:49:22 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:49:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a7d9a02f-acf3-449b-b631-36af76c24ae7 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:22 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a7d9a02f-acf3-449b-b631-36af76c24ae7 1073741824 Sep 04 15:49:22 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:23 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a7d9a02f-acf3-449b-b631-36af76c24ae7 1073741824" returned: 0 in 0.565s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a7d9a02f-acf3-449b-b631-36af76c24ae7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:23 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a7d9a02f-acf3-449b-b631-36af76c24ae7 Sep 04 15:49:23 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:23 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a7d9a02f-acf3-449b-b631-36af76c24ae7" returned: 0 in 0.382s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:49:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a50a670-e1a1-425d-b268-be9c7a1c8805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7d9a02f-acf3-449b-b631-36af76c24ae7', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2849f44-33ad-43b3-a7e3-b05ad69bfd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:23 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Volume volume-a7d9a02f-acf3-449b-b631-36af76c24ae7 (a7d9a02f-acf3-449b-b631-36af76c24ae7): created successfully Sep 04 15:49:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2849f44-33ad-43b3-a7e3-b05ad69bfd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Flow 'volume_create_manager' (b96d9296-3f55-48cb-9c4c-b6062e8a9d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:49:23 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-f0886b29-1af5-42fb-8aec-cb588ea988c7 tempest-GroupsTest-1312198782 None] Created volume successfully. Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Flow 'volume_create_manager' (c4ce8c47-595d-49dd-8301-5f7a3a4e843a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98935643-a63a-4498-a5d7-016007c2a6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98935643-a63a-4498-a5d7-016007c2a6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-543212207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c249c6a2-8065-40af-81db-8ca68a6759d2,host='devstack@QuobyteHD#QuobyteHD',id=05c6ba0a-1b60-4237-860a-547ec39eacd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a2dacf37e646b6a7c54d02e17316b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:49:26Z,use_quota=True,user_id='d58fe38d2de443f79e0dfa9499824506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f1c2865-4d49-41f4-87ba-c1badbb184ea),volume_type_id=6f1c2865-4d49-41f4-87ba-c1badbb184ea)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e80c22-be50-4d65-b5ea-3d283e830f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e80c22-be50-4d65-b5ea-3d283e830f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347ba73e-55c4-41fa-ae6d-506aee908ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347ba73e-55c4-41fa-ae6d-506aee908ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05c6ba0a-1b60-4237-860a-547ec39eacd3', 'volume_name': 'volume-05c6ba0a-1b60-4237-860a-547ec39eacd3', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd19e5a-b165-4103-bc37-750366d69b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd19e5a-b165-4103-bc37-750366d69b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749634b9-e847-49d8-a43f-610446ba8061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:25 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Volume 05c6ba0a-1b60-4237-860a-547ec39eacd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05c6ba0a-1b60-4237-860a-547ec39eacd3', 'volume_size': 1} Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c249c6a2-8065-40af-81db-8ca68a6759d2,created_at=2026-09-04T13:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-543212207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c249c6a2-8065-40af-81db-8ca68a6759d2,host='devstack@QuobyteHD#QuobyteHD',id=05c6ba0a-1b60-4237-860a-547ec39eacd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a2dacf37e646b6a7c54d02e17316b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:49:26Z,use_quota=True,user_id='d58fe38d2de443f79e0dfa9499824506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f1c2865-4d49-41f4-87ba-c1badbb184ea),volume_type_id=6f1c2865-4d49-41f4-87ba-c1badbb184ea)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Creating volume 05c6ba0a-1b60-4237-860a-547ec39eacd3 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:49:25 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:49:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05c6ba0a-1b60-4237-860a-547ec39eacd3 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:25 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05c6ba0a-1b60-4237-860a-547ec39eacd3 1073741824 Sep 04 15:49:25 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:26 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05c6ba0a-1b60-4237-860a-547ec39eacd3 1073741824" returned: 0 in 0.450s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05c6ba0a-1b60-4237-860a-547ec39eacd3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:26 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05c6ba0a-1b60-4237-860a-547ec39eacd3 Sep 04 15:49:26 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:26 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05c6ba0a-1b60-4237-860a-547ec39eacd3" returned: 0 in 0.308s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:49:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749634b9-e847-49d8-a43f-610446ba8061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05c6ba0a-1b60-4237-860a-547ec39eacd3', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b78b51-8b3e-4fb3-9d60-300c8d282ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:26 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Volume volume-05c6ba0a-1b60-4237-860a-547ec39eacd3 (05c6ba0a-1b60-4237-860a-547ec39eacd3): created successfully Sep 04 15:49:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b78b51-8b3e-4fb3-9d60-300c8d282ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Flow 'volume_create_manager' (c4ce8c47-595d-49dd-8301-5f7a3a4e843a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:49:26 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-7677c7b2-79a1-49d5-bccd-fc812b61ef39 tempest-GroupsTest-1312198782 None] Created volume successfully. Sep 04 15:49:27 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-5047f9fc-181f-43f4-9962-454442dc4754 tempest-GroupsTest-1312198782 None] Update group completed successfully. Sep 04 15:49:28 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-de1a80ae-7459-456e-a35e-e21a91e9fc53 tempest-GroupsTest-1312198782 None] Update group completed successfully. Sep 04 15:49:31 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Acquiring lock "cinder-quobyte-05c6ba0a-1b60-4237-860a-547ec39eacd3" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:49:31 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Lock "cinder-quobyte-05c6ba0a-1b60-4237-860a-547ec39eacd3" acquired by "delete_volume" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:49:31 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8292c671-cdbc-477e-9103-19bb5b71ec40]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:49:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05c6ba0a-1b60-4237-860a-547ec39eacd3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:31 devstack sudo[89299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05c6ba0a-1b60-4237-860a-547ec39eacd3 Sep 04 15:49:31 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:31 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05c6ba0a-1b60-4237-860a-547ec39eacd3" returned: 0 in 0.523s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05c6ba0a-1b60-4237-860a-547ec39eacd3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:31 devstack sudo[89306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05c6ba0a-1b60-4237-860a-547ec39eacd3 Sep 04 15:49:31 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:32 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05c6ba0a-1b60-4237-860a-547ec39eacd3" returned: 0 in 0.389s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Lock "cinder-quobyte-05c6ba0a-1b60-4237-860a-547ec39eacd3" released by "delete_volume" :: held 0.969s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:49:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Acquiring lock "cinder-quobyte-a7d9a02f-acf3-449b-b631-36af76c24ae7" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:49:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Lock "cinder-quobyte-a7d9a02f-acf3-449b-b631-36af76c24ae7" acquired by "delete_volume" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:49:32 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e303ca45-4a63-40da-9ab8-261d54a9f4c1]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:49:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a7d9a02f-acf3-449b-b631-36af76c24ae7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:32 devstack sudo[89321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a7d9a02f-acf3-449b-b631-36af76c24ae7 Sep 04 15:49:32 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:32 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a7d9a02f-acf3-449b-b631-36af76c24ae7" returned: 0 in 0.406s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a7d9a02f-acf3-449b-b631-36af76c24ae7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:32 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a7d9a02f-acf3-449b-b631-36af76c24ae7 Sep 04 15:49:32 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:33 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a7d9a02f-acf3-449b-b631-36af76c24ae7" returned: 0 in 0.315s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:33 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Lock "cinder-quobyte-a7d9a02f-acf3-449b-b631-36af76c24ae7" released by "delete_volume" :: held 0.774s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:49:33 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Created reservations ['45078158-9487-40d2-b9e3-3ae1a14d17d3'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:49:33 devstack cinder-volume[87513]: WARNING cinder.quota [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1125525774 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1125525774, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:49:33 devstack cinder-volume[87513]: WARNING cinder.quota [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1125525774 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1125525774, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:49:33 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Created reservations ['aea7457c-9a15-43e2-ac6e-2eea6cbdf35b', '84f11d90-6c8a-4519-b90d-5432a3105ad3', 'afe53c58-50dc-45e5-a370-ece274eda82f', '3b795253-d00c-4eaf-aebc-f0e20b3f9dfe'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:49:33 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Created reservations ['846ecd87-5d40-430a-b15a-abeb0fb3917f', 'a5899f09-3ccc-4695-a900-57ee6cdc15e2', '8aa32900-7bed-4586-a841-ef4cacc122d7', '4dacfecb-4115-4144-ae12-b959b6e23792'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:49:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:49:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:49:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:33 devstack sudo[89335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:49:33 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:33 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.408s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:33 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:49:33 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-d5eae94e-0eee-4df7-890b-928eb8cfcb00 tempest-GroupsTest-1312198782 None] Delete group completed successfully. Sep 04 15:49:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:49:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:49:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:49:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:34 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:49:34 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:35 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.305s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:49:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:49:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 8 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:49:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:49:43 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=87,cinder:UPDATE=98,cinder:INSERT=23,cinder:DELETE=2 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:49:43 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=86,cinder:SELECT=85,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:49:46 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-c0bd908e-a6b5-49ef-b69b-a6cd7fb297fb tempest-GroupsV320Test-2001667248 None] Group tempest-GroupsV320Test-Group-448304909: creating Sep 04 15:49:46 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-c0bd908e-a6b5-49ef-b69b-a6cd7fb297fb tempest-GroupsV320Test-2001667248 None] Group tempest-GroupsV320Test-Group-448304909: created successfully Sep 04 15:49:46 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-c0bd908e-a6b5-49ef-b69b-a6cd7fb297fb tempest-GroupsV320Test-2001667248 None] Create group completed successfully. Sep 04 15:49:48 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-ccc4797e-d9a6-4692-97e7-b59da55486f6 tempest-GroupsV320Test-2001667248 None] Created reservations ['cf176816-7822-443c-a92c-762dcd0cb331'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:49:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ccc4797e-d9a6-4692-97e7-b59da55486f6 tempest-GroupsV320Test-2001667248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ccc4797e-d9a6-4692-97e7-b59da55486f6 tempest-GroupsV320Test-2001667248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ccc4797e-d9a6-4692-97e7-b59da55486f6 tempest-GroupsV320Test-2001667248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:49:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ccc4797e-d9a6-4692-97e7-b59da55486f6 tempest-GroupsV320Test-2001667248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:49:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ccc4797e-d9a6-4692-97e7-b59da55486f6 tempest-GroupsV320Test-2001667248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ccc4797e-d9a6-4692-97e7-b59da55486f6 tempest-GroupsV320Test-2001667248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:48 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:49:48 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:49 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ccc4797e-d9a6-4692-97e7-b59da55486f6 tempest-GroupsV320Test-2001667248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.790s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:49 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-ccc4797e-d9a6-4692-97e7-b59da55486f6 tempest-GroupsV320Test-2001667248 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:49:49 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ccc4797e-d9a6-4692-97e7-b59da55486f6 tempest-GroupsV320Test-2001667248 None] Delete group completed successfully. Sep 04 15:49:58 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:49:58 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Flow 'volume_create_manager' (9cb8d259-2492-4099-bf29-b46995e5e4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff59e1a-a076-419f-8267-bd261bba1aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff59e1a-a076-419f-8267-bd261bba1aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1981234681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f1e50b-313c-403e-8f4c-67c46c369731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1096f9c6b4a4978ab6b0735c7131401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:11Z,use_quota=True,user_id='1baf5fe5c92a414fa9251854ab637166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc26bb5b-f8a2-4780-b599-ea68fcaa8557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc26bb5b-f8a2-4780-b599-ea68fcaa8557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f84a8f-8486-49da-a60f-2db555778768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f84a8f-8486-49da-a60f-2db555778768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05f1e50b-313c-403e-8f4c-67c46c369731', 'volume_name': 'volume-05f1e50b-313c-403e-8f4c-67c46c369731', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09de40f2-0c3d-4562-b040-008ecdc3d530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09de40f2-0c3d-4562-b040-008ecdc3d530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61de792e-639e-4b92-b9a6-b812484df54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:11 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Volume 05f1e50b-313c-403e-8f4c-67c46c369731: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05f1e50b-313c-403e-8f4c-67c46c369731', 'volume_size': 1} Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1981234681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f1e50b-313c-403e-8f4c-67c46c369731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1096f9c6b4a4978ab6b0735c7131401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:11Z,use_quota=True,user_id='1baf5fe5c92a414fa9251854ab637166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Creating volume 05f1e50b-313c-403e-8f4c-67c46c369731 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:50:11 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:50:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05f1e50b-313c-403e-8f4c-67c46c369731 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:11 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05f1e50b-313c-403e-8f4c-67c46c369731 1073741824 Sep 04 15:50:11 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:12 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05f1e50b-313c-403e-8f4c-67c46c369731 1073741824" returned: 0 in 1.007s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05f1e50b-313c-403e-8f4c-67c46c369731 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:12 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05f1e50b-313c-403e-8f4c-67c46c369731 Sep 04 15:50:12 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:12 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05f1e50b-313c-403e-8f4c-67c46c369731" returned: 0 in 0.368s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:50:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61de792e-639e-4b92-b9a6-b812484df54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05f1e50b-313c-403e-8f4c-67c46c369731', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ef0c5c0-932c-4b2c-98a7-120c0330cc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:12 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Volume volume-05f1e50b-313c-403e-8f4c-67c46c369731 (05f1e50b-313c-403e-8f4c-67c46c369731): created successfully Sep 04 15:50:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ef0c5c0-932c-4b2c-98a7-120c0330cc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Flow 'volume_create_manager' (9cb8d259-2492-4099-bf29-b46995e5e4b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:12 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-a02b2a1c-46c2-4d07-bd2f-b0a0983611b7 tempest-ServerRescueNegativeTestJSON-1688601047 None] Created volume successfully. Sep 04 15:50:22 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:50:22 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Flow 'volume_create_manager' (a3e25844-5b04-4a4e-bc69-4b80b0abd357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9331e71e-4229-4c48-bf15-bc9e7bbe660a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9331e71e-4229-4c48-bf15-bc9e7bbe660a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1264394311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee1ab83e-97c3-45ac-8216-4814d3b59a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d2863c7460147c8a8b857a52590f39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:32Z,use_quota=True,user_id='d564de51a59d468bbbd48b0b438c124b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a615c8f2-e30f-4180-a07b-4ad468f65fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a615c8f2-e30f-4180-a07b-4ad468f65fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d17b051-6062-4964-9dcf-1179f8205fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d17b051-6062-4964-9dcf-1179f8205fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee1ab83e-97c3-45ac-8216-4814d3b59a12', 'volume_name': 'volume-ee1ab83e-97c3-45ac-8216-4814d3b59a12', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b34769-ffc3-48f8-bbb4-bb1496632374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b34769-ffc3-48f8-bbb4-bb1496632374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed1b1a6-7a94-4ff8-9cca-8c6180ac8d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:31 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Volume ee1ab83e-97c3-45ac-8216-4814d3b59a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee1ab83e-97c3-45ac-8216-4814d3b59a12', 'volume_size': 1} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1264394311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee1ab83e-97c3-45ac-8216-4814d3b59a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d2863c7460147c8a8b857a52590f39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:32Z,use_quota=True,user_id='d564de51a59d468bbbd48b0b438c124b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Creating volume ee1ab83e-97c3-45ac-8216-4814d3b59a12 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:50:31 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ee1ab83e-97c3-45ac-8216-4814d3b59a12 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:31 devstack sudo[89921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ee1ab83e-97c3-45ac-8216-4814d3b59a12 1073741824 Sep 04 15:50:31 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Flow 'volume_create_manager' (11bd2f68-362a-41da-8a39-bfa7dbab29ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d601ccf9-ccec-4f0d-b98a-efe5ef238d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d601ccf9-ccec-4f0d-b98a-efe5ef238d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1846165687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b66440e-635c-4ebd-974e-b442c71cc00b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb38f1cb50e9439e8723ccbd2e8172a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:32Z,use_quota=True,user_id='ccad6b7531e34606af9114b841f5dc00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1998b79-64de-496d-90b4-c3428a205244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1998b79-64de-496d-90b4-c3428a205244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3c9305-5804-4344-84d9-a908577d0059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3c9305-5804-4344-84d9-a908577d0059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b66440e-635c-4ebd-974e-b442c71cc00b', 'volume_name': 'volume-7b66440e-635c-4ebd-974e-b442c71cc00b', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e389e3-0521-45de-9867-b87687c15909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e389e3-0521-45de-9867-b87687c15909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c8fd53-3f45-4a80-b445-c9192c8f5d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:31 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Volume 7b66440e-635c-4ebd-974e-b442c71cc00b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b66440e-635c-4ebd-974e-b442c71cc00b', 'volume_size': 1} Sep 04 15:50:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e0689ddd-726c-4ca4-a1a7-9293af17b2b9 tempest-ServerRescueNegativeTestJSON-1688601047 None] Acquiring lock "cinder-05f1e50b-313c-403e-8f4c-67c46c369731-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e0689ddd-726c-4ca4-a1a7-9293af17b2b9 tempest-ServerRescueNegativeTestJSON-1688601047 None] Lock "cinder-05f1e50b-313c-403e-8f4c-67c46c369731-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e0689ddd-726c-4ca4-a1a7-9293af17b2b9 tempest-ServerRescueNegativeTestJSON-1688601047 None] Acquiring lock "cinder-quobyte-05f1e50b-313c-403e-8f4c-67c46c369731" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e0689ddd-726c-4ca4-a1a7-9293af17b2b9 tempest-ServerRescueNegativeTestJSON-1688601047 None] Lock "cinder-quobyte-05f1e50b-313c-403e-8f4c-67c46c369731" acquired by "delete_volume" :: waited 0.026s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7790af4-1288-4b0c-a38b-74390bf7fd93]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e0689ddd-726c-4ca4-a1a7-9293af17b2b9 tempest-ServerRescueNegativeTestJSON-1688601047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05f1e50b-313c-403e-8f4c-67c46c369731 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:32 devstack sudo[89926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05f1e50b-313c-403e-8f4c-67c46c369731 Sep 04 15:50:32 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:32 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ee1ab83e-97c3-45ac-8216-4814d3b59a12 1073741824" returned: 0 in 0.649s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ee1ab83e-97c3-45ac-8216-4814d3b59a12 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:32 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ee1ab83e-97c3-45ac-8216-4814d3b59a12 Sep 04 15:50:32 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:32 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e0689ddd-726c-4ca4-a1a7-9293af17b2b9 tempest-ServerRescueNegativeTestJSON-1688601047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05f1e50b-313c-403e-8f4c-67c46c369731" returned: 0 in 0.504s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e0689ddd-726c-4ca4-a1a7-9293af17b2b9 tempest-ServerRescueNegativeTestJSON-1688601047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05f1e50b-313c-403e-8f4c-67c46c369731 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:32 devstack sudo[89935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05f1e50b-313c-403e-8f4c-67c46c369731 Sep 04 15:50:32 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:32 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ee1ab83e-97c3-45ac-8216-4814d3b59a12" returned: 0 in 0.365s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.945s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1846165687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b66440e-635c-4ebd-974e-b442c71cc00b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb38f1cb50e9439e8723ccbd2e8172a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:32Z,use_quota=True,user_id='ccad6b7531e34606af9114b841f5dc00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Creating volume 7b66440e-635c-4ebd-974e-b442c71cc00b {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:50:32 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7b66440e-635c-4ebd-974e-b442c71cc00b 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed1b1a6-7a94-4ff8-9cca-8c6180ac8d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee1ab83e-97c3-45ac-8216-4814d3b59a12', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665bdf53-2d07-418d-b10d-94d5a9fa35ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:32 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7b66440e-635c-4ebd-974e-b442c71cc00b 1073741824 Sep 04 15:50:32 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:32 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Volume volume-ee1ab83e-97c3-45ac-8216-4814d3b59a12 (ee1ab83e-97c3-45ac-8216-4814d3b59a12): created successfully Sep 04 15:50:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665bdf53-2d07-418d-b10d-94d5a9fa35ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Flow 'volume_create_manager' (a3e25844-5b04-4a4e-bc69-4b80b0abd357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:33 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-147e0d4e-f1b4-43ec-8f0c-9e6c667e860a tempest-TaggedAttachmentsTest-364679748 None] Created volume successfully. Sep 04 15:50:33 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e0689ddd-726c-4ca4-a1a7-9293af17b2b9 tempest-ServerRescueNegativeTestJSON-1688601047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-05f1e50b-313c-403e-8f4c-67c46c369731" returned: 0 in 0.409s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:33 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e0689ddd-726c-4ca4-a1a7-9293af17b2b9 tempest-ServerRescueNegativeTestJSON-1688601047 None] Lock "cinder-quobyte-05f1e50b-313c-403e-8f4c-67c46c369731" released by "delete_volume" :: held 0.973s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:50:33 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-e0689ddd-726c-4ca4-a1a7-9293af17b2b9 tempest-ServerRescueNegativeTestJSON-1688601047 None] Created reservations ['7ffd65f4-f0e9-4f05-9b2d-b6f49e9e352b', 'e6fafebe-6bce-4732-bb5b-0d5e72aafcdc', '15270a9b-9307-4af2-a010-0e46cdb55476', '00ac716e-46d1-42a6-a234-9852a5f6fef8'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:50:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e0689ddd-726c-4ca4-a1a7-9293af17b2b9 tempest-ServerRescueNegativeTestJSON-1688601047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e0689ddd-726c-4ca4-a1a7-9293af17b2b9 tempest-ServerRescueNegativeTestJSON-1688601047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e0689ddd-726c-4ca4-a1a7-9293af17b2b9 tempest-ServerRescueNegativeTestJSON-1688601047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:50:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e0689ddd-726c-4ca4-a1a7-9293af17b2b9 tempest-ServerRescueNegativeTestJSON-1688601047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:50:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e0689ddd-726c-4ca4-a1a7-9293af17b2b9 tempest-ServerRescueNegativeTestJSON-1688601047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e0689ddd-726c-4ca4-a1a7-9293af17b2b9 tempest-ServerRescueNegativeTestJSON-1688601047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:33 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:50:33 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:33 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7b66440e-635c-4ebd-974e-b442c71cc00b 1073741824" returned: 0 in 0.730s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7b66440e-635c-4ebd-974e-b442c71cc00b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:33 devstack sudo[89949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7b66440e-635c-4ebd-974e-b442c71cc00b Sep 04 15:50:33 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:34 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e0689ddd-726c-4ca4-a1a7-9293af17b2b9 tempest-ServerRescueNegativeTestJSON-1688601047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.582s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:34 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-e0689ddd-726c-4ca4-a1a7-9293af17b2b9 tempest-ServerRescueNegativeTestJSON-1688601047 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:50:34 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e0689ddd-726c-4ca4-a1a7-9293af17b2b9 tempest-ServerRescueNegativeTestJSON-1688601047 None] Deleted volume successfully. Sep 04 15:50:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e0689ddd-726c-4ca4-a1a7-9293af17b2b9 tempest-ServerRescueNegativeTestJSON-1688601047 None] Lock "cinder-05f1e50b-313c-403e-8f4c-67c46c369731-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:50:34 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7b66440e-635c-4ebd-974e-b442c71cc00b" returned: 0 in 0.590s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:50:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c8fd53-3f45-4a80-b445-c9192c8f5d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b66440e-635c-4ebd-974e-b442c71cc00b', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c63bde-656c-4d8d-beee-a6a86b27b526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:34 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Volume volume-7b66440e-635c-4ebd-974e-b442c71cc00b (7b66440e-635c-4ebd-974e-b442c71cc00b): created successfully Sep 04 15:50:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c63bde-656c-4d8d-beee-a6a86b27b526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Flow 'volume_create_manager' (11bd2f68-362a-41da-8a39-bfa7dbab29ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:34 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-66ffbd74-488e-401b-bf81-bdb7c8225f44 tempest-ServersNegativeTestJSON-1974310279 None] Created volume successfully. Sep 04 15:50:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:50:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:50:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:50:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:34 devstack sudo[89954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:50:34 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:35 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.687s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:50:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:50:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 8 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:50:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:50:39 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:50:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Flow 'volume_create_manager' (6e5bac1f-a554-47cd-bf67-c5a1e216b04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a0408d-fe7e-4eda-a31c-10563b4473e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a0408d-fe7e-4eda-a31c-10563b4473e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-652934409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=237453e2-1b43-446a-9850-cd9625767cd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb38f1cb50e9439e8723ccbd2e8172a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:40Z,use_quota=True,user_id='ccad6b7531e34606af9114b841f5dc00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49215b62-660a-417f-9628-de2d45d2095a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49215b62-660a-417f-9628-de2d45d2095a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dbceb71-4379-4247-8eb5-8bf566941582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dbceb71-4379-4247-8eb5-8bf566941582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '237453e2-1b43-446a-9850-cd9625767cd3', 'volume_name': 'volume-237453e2-1b43-446a-9850-cd9625767cd3', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3091d2-f449-405b-a2fe-53e9eaf8b901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3091d2-f449-405b-a2fe-53e9eaf8b901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a666030-62f7-44a3-8617-75e19134d89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:40 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Volume 237453e2-1b43-446a-9850-cd9625767cd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-237453e2-1b43-446a-9850-cd9625767cd3', 'volume_size': 1} Sep 04 15:50:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-652934409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=237453e2-1b43-446a-9850-cd9625767cd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb38f1cb50e9439e8723ccbd2e8172a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:40Z,use_quota=True,user_id='ccad6b7531e34606af9114b841f5dc00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:50:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Creating volume 237453e2-1b43-446a-9850-cd9625767cd3 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:50:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:50:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:50:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:50:40 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:50:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-237453e2-1b43-446a-9850-cd9625767cd3 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:40 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-237453e2-1b43-446a-9850-cd9625767cd3 1073741824 Sep 04 15:50:40 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:40 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-237453e2-1b43-446a-9850-cd9625767cd3 1073741824" returned: 0 in 0.647s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-237453e2-1b43-446a-9850-cd9625767cd3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:40 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-237453e2-1b43-446a-9850-cd9625767cd3 Sep 04 15:50:40 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:41 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-237453e2-1b43-446a-9850-cd9625767cd3" returned: 0 in 0.381s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:41 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:50:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:41 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a666030-62f7-44a3-8617-75e19134d89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-237453e2-1b43-446a-9850-cd9625767cd3', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:41 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (951f4de2-65b3-4daa-b062-e8d2093cf08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:41 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Volume volume-237453e2-1b43-446a-9850-cd9625767cd3 (237453e2-1b43-446a-9850-cd9625767cd3): created successfully Sep 04 15:50:41 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (951f4de2-65b3-4daa-b062-e8d2093cf08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:41 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Flow 'volume_create_manager' (6e5bac1f-a554-47cd-bf67-c5a1e216b04f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:41 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ae608185-30e6-4c37-8560-92108fe9736e tempest-ServersNegativeTestJSON-1974310279 None] Created volume successfully. Sep 04 15:50:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-385b1300-dce6-4fd7-9b48-776e1d61e7d1 tempest-ServersNegativeTestJSON-1974310279 None] Acquiring lock "cinder-237453e2-1b43-446a-9850-cd9625767cd3-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:50:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-385b1300-dce6-4fd7-9b48-776e1d61e7d1 tempest-ServersNegativeTestJSON-1974310279 None] Lock "cinder-237453e2-1b43-446a-9850-cd9625767cd3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:50:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-385b1300-dce6-4fd7-9b48-776e1d61e7d1 tempest-ServersNegativeTestJSON-1974310279 None] Acquiring lock "cinder-quobyte-237453e2-1b43-446a-9850-cd9625767cd3" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:50:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-385b1300-dce6-4fd7-9b48-776e1d61e7d1 tempest-ServersNegativeTestJSON-1974310279 None] Lock "cinder-quobyte-237453e2-1b43-446a-9850-cd9625767cd3" acquired by "delete_volume" :: waited 0.042s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:50:43 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9d3c28-d148-4291-ae91-134f16d44d3a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:50:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-385b1300-dce6-4fd7-9b48-776e1d61e7d1 tempest-ServersNegativeTestJSON-1974310279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-237453e2-1b43-446a-9850-cd9625767cd3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:43 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-237453e2-1b43-446a-9850-cd9625767cd3 Sep 04 15:50:43 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:43 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-385b1300-dce6-4fd7-9b48-776e1d61e7d1 tempest-ServersNegativeTestJSON-1974310279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-237453e2-1b43-446a-9850-cd9625767cd3" returned: 0 in 0.588s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-385b1300-dce6-4fd7-9b48-776e1d61e7d1 tempest-ServersNegativeTestJSON-1974310279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-237453e2-1b43-446a-9850-cd9625767cd3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:43 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-237453e2-1b43-446a-9850-cd9625767cd3 Sep 04 15:50:43 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:43 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-385b1300-dce6-4fd7-9b48-776e1d61e7d1 tempest-ServersNegativeTestJSON-1974310279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-237453e2-1b43-446a-9850-cd9625767cd3" returned: 0 in 0.365s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-385b1300-dce6-4fd7-9b48-776e1d61e7d1 tempest-ServersNegativeTestJSON-1974310279 None] Lock "cinder-quobyte-237453e2-1b43-446a-9850-cd9625767cd3" released by "delete_volume" :: held 1.028s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-385b1300-dce6-4fd7-9b48-776e1d61e7d1 tempest-ServersNegativeTestJSON-1974310279 None] Created reservations ['f4fda14c-3125-4e17-925d-51f28cd439a5', 'de014ef5-c7bd-4f17-8518-753b71ea5ced', '41a110d2-4b95-42e3-83fd-ccfb67d6ccb1', '3cbcae59-b41d-4081-8065-a82c6bde5738'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-385b1300-dce6-4fd7-9b48-776e1d61e7d1 tempest-ServersNegativeTestJSON-1974310279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-385b1300-dce6-4fd7-9b48-776e1d61e7d1 tempest-ServersNegativeTestJSON-1974310279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-385b1300-dce6-4fd7-9b48-776e1d61e7d1 tempest-ServersNegativeTestJSON-1974310279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-385b1300-dce6-4fd7-9b48-776e1d61e7d1 tempest-ServersNegativeTestJSON-1974310279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-385b1300-dce6-4fd7-9b48-776e1d61e7d1 tempest-ServersNegativeTestJSON-1974310279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-385b1300-dce6-4fd7-9b48-776e1d61e7d1 tempest-ServersNegativeTestJSON-1974310279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:44 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:50:44 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Flow 'volume_create_manager' (86c79c7b-1323-4397-9567-70310b8b22b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf994b6b-f3da-41d8-ae9c-f43c0cb8d8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf994b6b-f3da-41d8-ae9c-f43c0cb8d8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1459875719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b9e891-d91d-4baa-a20c-e681ae51961e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31664ddfb51428fbeecb33e43cbb4db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:44Z,use_quota=True,user_id='29699d25e21d478fbaf5c02e4f8216c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae96f889-2094-407d-a425-185a9f339b05),volume_type_id=ae96f889-2094-407d-a425-185a9f339b05)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25799bc-7691-4d79-b88b-f0ad1241e450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25799bc-7691-4d79-b88b-f0ad1241e450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (945ecc4d-68f6-4867-8083-214cba469269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (945ecc4d-68f6-4867-8083-214cba469269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1b9e891-d91d-4baa-a20c-e681ae51961e', 'volume_name': 'volume-c1b9e891-d91d-4baa-a20c-e681ae51961e', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c89595-b441-4bcf-a009-63d7ce275c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c89595-b441-4bcf-a009-63d7ce275c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e2b970d-385c-43a2-9308-744b773bbcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:44 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Volume c1b9e891-d91d-4baa-a20c-e681ae51961e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1b9e891-d91d-4baa-a20c-e681ae51961e', 'volume_size': 1} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1459875719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b9e891-d91d-4baa-a20c-e681ae51961e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31664ddfb51428fbeecb33e43cbb4db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:44Z,use_quota=True,user_id='29699d25e21d478fbaf5c02e4f8216c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae96f889-2094-407d-a425-185a9f339b05),volume_type_id=ae96f889-2094-407d-a425-185a9f339b05)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Creating volume c1b9e891-d91d-4baa-a20c-e681ae51961e {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:50:44 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c1b9e891-d91d-4baa-a20c-e681ae51961e 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:44 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-385b1300-dce6-4fd7-9b48-776e1d61e7d1 tempest-ServersNegativeTestJSON-1974310279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.283s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-385b1300-dce6-4fd7-9b48-776e1d61e7d1 tempest-ServersNegativeTestJSON-1974310279 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:50:44 devstack sudo[90078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c1b9e891-d91d-4baa-a20c-e681ae51961e 1073741824 Sep 04 15:50:44 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:44 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-385b1300-dce6-4fd7-9b48-776e1d61e7d1 tempest-ServersNegativeTestJSON-1974310279 None] Deleted volume successfully. Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-385b1300-dce6-4fd7-9b48-776e1d61e7d1 tempest-ServersNegativeTestJSON-1974310279 None] Lock "cinder-237453e2-1b43-446a-9850-cd9625767cd3-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:50:44 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c1b9e891-d91d-4baa-a20c-e681ae51961e 1073741824" returned: 0 in 0.529s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c1b9e891-d91d-4baa-a20c-e681ae51961e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:45 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c1b9e891-d91d-4baa-a20c-e681ae51961e Sep 04 15:50:45 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-fee7a5ff-e582-47d1-8e76-8b0bd5a12cbe tempest-ServersNegativeTestJSON-1974310279 None] Acquiring lock "cinder-7b66440e-635c-4ebd-974e-b442c71cc00b-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:50:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-fee7a5ff-e582-47d1-8e76-8b0bd5a12cbe tempest-ServersNegativeTestJSON-1974310279 None] Lock "cinder-7b66440e-635c-4ebd-974e-b442c71cc00b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:50:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-fee7a5ff-e582-47d1-8e76-8b0bd5a12cbe tempest-ServersNegativeTestJSON-1974310279 None] Acquiring lock "cinder-quobyte-7b66440e-635c-4ebd-974e-b442c71cc00b" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:50:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-fee7a5ff-e582-47d1-8e76-8b0bd5a12cbe tempest-ServersNegativeTestJSON-1974310279 None] Lock "cinder-quobyte-7b66440e-635c-4ebd-974e-b442c71cc00b" acquired by "delete_volume" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:50:45 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c1b9e891-d91d-4baa-a20c-e681ae51961e" returned: 0 in 0.323s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:50:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e2b970d-385c-43a2-9308-744b773bbcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1b9e891-d91d-4baa-a20c-e681ae51961e', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6c977b-6b50-4964-8ea2-0853c62e750c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:45 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a132fed-df88-4ee5-a95a-eaee6361f161]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:50:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fee7a5ff-e582-47d1-8e76-8b0bd5a12cbe tempest-ServersNegativeTestJSON-1974310279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7b66440e-635c-4ebd-974e-b442c71cc00b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:45 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Volume volume-c1b9e891-d91d-4baa-a20c-e681ae51961e (c1b9e891-d91d-4baa-a20c-e681ae51961e): created successfully Sep 04 15:50:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6c977b-6b50-4964-8ea2-0853c62e750c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Flow 'volume_create_manager' (86c79c7b-1323-4397-9567-70310b8b22b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:45 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-2bb9d050-aea0-4b4e-bed5-666dc39c7a09 tempest-VolumeTypesAccessTest-500022148 None] Created volume successfully. Sep 04 15:50:45 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7b66440e-635c-4ebd-974e-b442c71cc00b Sep 04 15:50:45 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:46 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fee7a5ff-e582-47d1-8e76-8b0bd5a12cbe tempest-ServersNegativeTestJSON-1974310279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7b66440e-635c-4ebd-974e-b442c71cc00b" returned: 0 in 0.621s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fee7a5ff-e582-47d1-8e76-8b0bd5a12cbe tempest-ServersNegativeTestJSON-1974310279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7b66440e-635c-4ebd-974e-b442c71cc00b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:46 devstack sudo[90124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7b66440e-635c-4ebd-974e-b442c71cc00b Sep 04 15:50:46 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:46 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fee7a5ff-e582-47d1-8e76-8b0bd5a12cbe tempest-ServersNegativeTestJSON-1974310279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7b66440e-635c-4ebd-974e-b442c71cc00b" returned: 0 in 0.356s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-fee7a5ff-e582-47d1-8e76-8b0bd5a12cbe tempest-ServersNegativeTestJSON-1974310279 None] Lock "cinder-quobyte-7b66440e-635c-4ebd-974e-b442c71cc00b" released by "delete_volume" :: held 1.057s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:50:46 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-fee7a5ff-e582-47d1-8e76-8b0bd5a12cbe tempest-ServersNegativeTestJSON-1974310279 None] Created reservations ['9afb391b-c02f-45b9-909b-9d221671fc70', '69554ccc-9ba5-41e0-95d6-aaaf39948b03', '20529cd4-9b55-4b40-9efd-8495a1e327e3', '4a83826f-c313-423a-b9e8-8eb8b049f74c'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:50:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fee7a5ff-e582-47d1-8e76-8b0bd5a12cbe tempest-ServersNegativeTestJSON-1974310279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fee7a5ff-e582-47d1-8e76-8b0bd5a12cbe tempest-ServersNegativeTestJSON-1974310279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-fee7a5ff-e582-47d1-8e76-8b0bd5a12cbe tempest-ServersNegativeTestJSON-1974310279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:50:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-fee7a5ff-e582-47d1-8e76-8b0bd5a12cbe tempest-ServersNegativeTestJSON-1974310279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:50:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fee7a5ff-e582-47d1-8e76-8b0bd5a12cbe tempest-ServersNegativeTestJSON-1974310279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fee7a5ff-e582-47d1-8e76-8b0bd5a12cbe tempest-ServersNegativeTestJSON-1974310279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:46 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:50:46 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] Acquiring lock "cinder-c1b9e891-d91d-4baa-a20c-e681ae51961e-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:50:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] Lock "cinder-c1b9e891-d91d-4baa-a20c-e681ae51961e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:50:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] Acquiring lock "cinder-quobyte-c1b9e891-d91d-4baa-a20c-e681ae51961e" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:50:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] Lock "cinder-quobyte-c1b9e891-d91d-4baa-a20c-e681ae51961e" acquired by "delete_volume" :: waited 0.028s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:50:47 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[256916ee-1510-4cb2-b1ee-fe7ee1641a26]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:50:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c1b9e891-d91d-4baa-a20c-e681ae51961e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:47 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c1b9e891-d91d-4baa-a20c-e681ae51961e Sep 04 15:50:47 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:47 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fee7a5ff-e582-47d1-8e76-8b0bd5a12cbe tempest-ServersNegativeTestJSON-1974310279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.597s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:47 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-fee7a5ff-e582-47d1-8e76-8b0bd5a12cbe tempest-ServersNegativeTestJSON-1974310279 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:50:47 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-fee7a5ff-e582-47d1-8e76-8b0bd5a12cbe tempest-ServersNegativeTestJSON-1974310279 None] Deleted volume successfully. Sep 04 15:50:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-fee7a5ff-e582-47d1-8e76-8b0bd5a12cbe tempest-ServersNegativeTestJSON-1974310279 None] Lock "cinder-7b66440e-635c-4ebd-974e-b442c71cc00b-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:50:47 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c1b9e891-d91d-4baa-a20c-e681ae51961e" returned: 0 in 0.622s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c1b9e891-d91d-4baa-a20c-e681ae51961e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:47 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c1b9e891-d91d-4baa-a20c-e681ae51961e Sep 04 15:50:47 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:48 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c1b9e891-d91d-4baa-a20c-e681ae51961e" returned: 0 in 0.367s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] Lock "cinder-quobyte-c1b9e891-d91d-4baa-a20c-e681ae51961e" released by "delete_volume" :: held 1.093s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:50:48 devstack cinder-volume[87513]: WARNING cinder.quota [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-594340884 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-594340884, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:50:48 devstack cinder-volume[87513]: WARNING cinder.quota [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-594340884 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-594340884, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:50:48 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] Created reservations ['1ca2ee81-2361-4fd9-b2d2-3bcb1168b97d', '55f5bad2-c740-4fca-8d10-c254bcf5a956', 'ac3292bc-4bcd-4341-8c4d-253a40255df3', '1dd94da3-cfd3-4968-85aa-2e7620f3837c'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:50:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:50:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:50:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:48 devstack sudo[90195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:50:48 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:48 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.609s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:48 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:50:48 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] Deleted volume successfully. Sep 04 15:50:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-082965bb-6e3e-43c4-a266-9775826cee37 tempest-VolumeTypesAccessTest-500022148 None] Lock "cinder-c1b9e891-d91d-4baa-a20c-e681ae51961e-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:50:58 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=30,cinder:UPDATE=42,cinder:DELETE=4,cinder:INSERT=11 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:50:58 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=46,cinder:SELECT=26,cinder:INSERT=9,cinder:DELETE=4 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Flow 'volume_create_manager' (eb494a1a-897a-4bed-ae50-0d39691a9ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10979e8d-e051-435d-9681-45a2c7d93c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10979e8d-e051-435d-9681-45a2c7d93c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-824618550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3b40eb-9534-4496-ab79-3a9078fd5120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf48404a1fb443ebd0daf020947c15c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:03Z,use_quota=True,user_id='85fbd5f6fc72450e8eb97582b66be0dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8111c5fd-7c18-4e87-bfe6-8ec0257ae842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8111c5fd-7c18-4e87-bfe6-8ec0257ae842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0100cd82-b765-44d3-9d82-742c2c381bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0100cd82-b765-44d3-9d82-742c2c381bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a3b40eb-9534-4496-ab79-3a9078fd5120', 'volume_name': 'volume-0a3b40eb-9534-4496-ab79-3a9078fd5120', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9f97b7-523f-47ea-ba8c-9ad489d82729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9f97b7-523f-47ea-ba8c-9ad489d82729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26aca114-e2fc-4d82-80aa-4600f36b9179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:03 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Volume 0a3b40eb-9534-4496-ab79-3a9078fd5120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a3b40eb-9534-4496-ab79-3a9078fd5120', 'volume_size': 1} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-824618550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3b40eb-9534-4496-ab79-3a9078fd5120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf48404a1fb443ebd0daf020947c15c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:03Z,use_quota=True,user_id='85fbd5f6fc72450e8eb97582b66be0dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Creating volume 0a3b40eb-9534-4496-ab79-3a9078fd5120 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:51:03 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0a3b40eb-9534-4496-ab79-3a9078fd5120 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:03 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0a3b40eb-9534-4496-ab79-3a9078fd5120 1073741824 Sep 04 15:51:03 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Flow 'volume_create_manager' (49c5e966-b48d-42f5-9e6b-a747206b5dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af7043e-8da9-4e52-a48a-39c0adbda133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af7043e-8da9-4e52-a48a-39c0adbda133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1304345112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60277e71-d5f8-4c10-8fae-a18a4f551f65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='44f624fce6524ef4a4ba86fcec1c9429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:03Z,use_quota=True,user_id='a5e017f2670148f496903aae719c630b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17688889-ef8f-4ffd-80e9-fb8b70e18739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17688889-ef8f-4ffd-80e9-fb8b70e18739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca38a2fb-55a4-46e6-b7d9-004f4be99e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca38a2fb-55a4-46e6-b7d9-004f4be99e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60277e71-d5f8-4c10-8fae-a18a4f551f65', 'volume_name': 'volume-60277e71-d5f8-4c10-8fae-a18a4f551f65', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3edbe4bd-753d-4c01-8772-5ec8de9f07a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3edbe4bd-753d-4c01-8772-5ec8de9f07a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36aa3d0f-6401-49b1-99ff-32aee655b7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:03 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Volume 60277e71-d5f8-4c10-8fae-a18a4f551f65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60277e71-d5f8-4c10-8fae-a18a4f551f65', 'volume_size': 1} Sep 04 15:51:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:04 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0a3b40eb-9534-4496-ab79-3a9078fd5120 1073741824" returned: 0 in 0.623s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0a3b40eb-9534-4496-ab79-3a9078fd5120 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:04 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0a3b40eb-9534-4496-ab79-3a9078fd5120 Sep 04 15:51:04 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:04 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0a3b40eb-9534-4496-ab79-3a9078fd5120" returned: 0 in 0.294s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:51:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.744s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1304345112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60277e71-d5f8-4c10-8fae-a18a4f551f65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='44f624fce6524ef4a4ba86fcec1c9429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:03Z,use_quota=True,user_id='a5e017f2670148f496903aae719c630b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:51:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Creating volume 60277e71-d5f8-4c10-8fae-a18a4f551f65 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:51:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:51:04 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:51:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-60277e71-d5f8-4c10-8fae-a18a4f551f65 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26aca114-e2fc-4d82-80aa-4600f36b9179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a3b40eb-9534-4496-ab79-3a9078fd5120', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:04 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-60277e71-d5f8-4c10-8fae-a18a4f551f65 1073741824 Sep 04 15:51:04 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b994b1-2116-4cfa-b771-d0dfd64cfebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:04 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Volume volume-0a3b40eb-9534-4496-ab79-3a9078fd5120 (0a3b40eb-9534-4496-ab79-3a9078fd5120): created successfully Sep 04 15:51:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b994b1-2116-4cfa-b771-d0dfd64cfebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Flow 'volume_create_manager' (eb494a1a-897a-4bed-ae50-0d39691a9ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:04 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-57a11785-8d76-4d68-9996-bc6a75614421 tempest-VolumesListAdminTestJSON-2015028405 None] Created volume successfully. Sep 04 15:51:04 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-60277e71-d5f8-4c10-8fae-a18a4f551f65 1073741824" returned: 0 in 0.488s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-60277e71-d5f8-4c10-8fae-a18a4f551f65 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:05 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-60277e71-d5f8-4c10-8fae-a18a4f551f65 Sep 04 15:51:05 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:05 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-60277e71-d5f8-4c10-8fae-a18a4f551f65" returned: 0 in 0.245s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:51:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36aa3d0f-6401-49b1-99ff-32aee655b7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60277e71-d5f8-4c10-8fae-a18a4f551f65', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34aa025-ee4b-4240-8524-4c0896c6df41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:05 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Volume volume-60277e71-d5f8-4c10-8fae-a18a4f551f65 (60277e71-d5f8-4c10-8fae-a18a4f551f65): created successfully Sep 04 15:51:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34aa025-ee4b-4240-8524-4c0896c6df41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Flow 'volume_create_manager' (49c5e966-b48d-42f5-9e6b-a747206b5dae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:05 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-b5027606-3f14-4a1c-ac0e-bfc221a45600 req-9c74d277-4a07-4ea9-afe1-ba34136575ed tempest-VolumesGetTestJSON-1035823882 None] Created volume successfully. Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Flow 'volume_create_manager' (e8c54415-dd85-4625-83b8-9a24a661fe63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804d0280-cfd7-4028-b489-8e09b89b46cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-54933411-bbee-4b0c-8f44-d3cb4b1bc90f req-1f377179-a9ee-457b-baa7-836554bc8506 tempest-VolumesGetTestJSON-1035823882 None] Acquiring lock "cinder-60277e71-d5f8-4c10-8fae-a18a4f551f65-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804d0280-cfd7-4028-b489-8e09b89b46cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1502168976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327d1310-8009-4644-a39e-1cce3391ee5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf48404a1fb443ebd0daf020947c15c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:06Z,use_quota=True,user_id='85fbd5f6fc72450e8eb97582b66be0dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d554b4-840e-414d-86ba-970fc7fc2741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d554b4-840e-414d-86ba-970fc7fc2741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f60dc6f6-8d34-4c56-bf4d-00c9212b1efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f60dc6f6-8d34-4c56-bf4d-00c9212b1efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '327d1310-8009-4644-a39e-1cce3391ee5d', 'volume_name': 'volume-327d1310-8009-4644-a39e-1cce3391ee5d', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb0412b-01bc-42d5-846c-bdbc459a9bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb0412b-01bc-42d5-846c-bdbc459a9bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391bd590-9e19-4888-a8ce-6f1cca9f2306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:06 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Volume 327d1310-8009-4644-a39e-1cce3391ee5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-327d1310-8009-4644-a39e-1cce3391ee5d', 'volume_size': 1} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1502168976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327d1310-8009-4644-a39e-1cce3391ee5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf48404a1fb443ebd0daf020947c15c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:06Z,use_quota=True,user_id='85fbd5f6fc72450e8eb97582b66be0dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Creating volume 327d1310-8009-4644-a39e-1cce3391ee5d {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:51:06 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-327d1310-8009-4644-a39e-1cce3391ee5d 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:06 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-327d1310-8009-4644-a39e-1cce3391ee5d 1073741824 Sep 04 15:51:06 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-54933411-bbee-4b0c-8f44-d3cb4b1bc90f req-1f377179-a9ee-457b-baa7-836554bc8506 tempest-VolumesGetTestJSON-1035823882 None] Lock "cinder-60277e71-d5f8-4c10-8fae-a18a4f551f65-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-54933411-bbee-4b0c-8f44-d3cb4b1bc90f req-1f377179-a9ee-457b-baa7-836554bc8506 tempest-VolumesGetTestJSON-1035823882 None] Acquiring lock "cinder-quobyte-60277e71-d5f8-4c10-8fae-a18a4f551f65" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-54933411-bbee-4b0c-8f44-d3cb4b1bc90f req-1f377179-a9ee-457b-baa7-836554bc8506 tempest-VolumesGetTestJSON-1035823882 None] Lock "cinder-quobyte-60277e71-d5f8-4c10-8fae-a18a4f551f65" acquired by "delete_volume" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c121d77-4284-4ee8-b6e4-fc2e0d9fbf62]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-54933411-bbee-4b0c-8f44-d3cb4b1bc90f req-1f377179-a9ee-457b-baa7-836554bc8506 tempest-VolumesGetTestJSON-1035823882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-60277e71-d5f8-4c10-8fae-a18a4f551f65 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:06 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-60277e71-d5f8-4c10-8fae-a18a4f551f65 Sep 04 15:51:06 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:06 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-327d1310-8009-4644-a39e-1cce3391ee5d 1073741824" returned: 0 in 0.591s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:06 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-54933411-bbee-4b0c-8f44-d3cb4b1bc90f req-1f377179-a9ee-457b-baa7-836554bc8506 tempest-VolumesGetTestJSON-1035823882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-60277e71-d5f8-4c10-8fae-a18a4f551f65" returned: 0 in 0.494s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-54933411-bbee-4b0c-8f44-d3cb4b1bc90f req-1f377179-a9ee-457b-baa7-836554bc8506 tempest-VolumesGetTestJSON-1035823882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-60277e71-d5f8-4c10-8fae-a18a4f551f65 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:06 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-60277e71-d5f8-4c10-8fae-a18a4f551f65 Sep 04 15:51:06 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-327d1310-8009-4644-a39e-1cce3391ee5d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:06 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-327d1310-8009-4644-a39e-1cce3391ee5d Sep 04 15:51:06 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:07 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-54933411-bbee-4b0c-8f44-d3cb4b1bc90f req-1f377179-a9ee-457b-baa7-836554bc8506 tempest-VolumesGetTestJSON-1035823882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-60277e71-d5f8-4c10-8fae-a18a4f551f65" returned: 0 in 0.299s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-54933411-bbee-4b0c-8f44-d3cb4b1bc90f req-1f377179-a9ee-457b-baa7-836554bc8506 tempest-VolumesGetTestJSON-1035823882 None] Lock "cinder-quobyte-60277e71-d5f8-4c10-8fae-a18a4f551f65" released by "delete_volume" :: held 0.845s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:07 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-327d1310-8009-4644-a39e-1cce3391ee5d" returned: 0 in 0.343s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:51:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391bd590-9e19-4888-a8ce-6f1cca9f2306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-327d1310-8009-4644-a39e-1cce3391ee5d', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3895300b-d262-4279-a02d-a8b58a6419c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:07 devstack cinder-volume[87513]: DEBUG cinder.quota [req-54933411-bbee-4b0c-8f44-d3cb4b1bc90f req-1f377179-a9ee-457b-baa7-836554bc8506 tempest-VolumesGetTestJSON-1035823882 None] Created reservations ['c92f96a3-bd51-43b2-8742-cffcf9afa238', '86e523f6-113a-4435-bfdb-d7cf1aca2dfb', 'febb8242-c324-4002-8bef-a6fdcaf82f99', '2af0c35d-f30f-4a58-a96e-69993ace4b8d'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:51:07 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Volume volume-327d1310-8009-4644-a39e-1cce3391ee5d (327d1310-8009-4644-a39e-1cce3391ee5d): created successfully Sep 04 15:51:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3895300b-d262-4279-a02d-a8b58a6419c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Flow 'volume_create_manager' (e8c54415-dd85-4625-83b8-9a24a661fe63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:07 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-1686019f-7a71-47a5-81f5-8f598093096e tempest-VolumesListAdminTestJSON-2015028405 None] Created volume successfully. Sep 04 15:51:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-54933411-bbee-4b0c-8f44-d3cb4b1bc90f req-1f377179-a9ee-457b-baa7-836554bc8506 tempest-VolumesGetTestJSON-1035823882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-54933411-bbee-4b0c-8f44-d3cb4b1bc90f req-1f377179-a9ee-457b-baa7-836554bc8506 tempest-VolumesGetTestJSON-1035823882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [req-54933411-bbee-4b0c-8f44-d3cb4b1bc90f req-1f377179-a9ee-457b-baa7-836554bc8506 tempest-VolumesGetTestJSON-1035823882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [req-54933411-bbee-4b0c-8f44-d3cb4b1bc90f req-1f377179-a9ee-457b-baa7-836554bc8506 tempest-VolumesGetTestJSON-1035823882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-54933411-bbee-4b0c-8f44-d3cb4b1bc90f req-1f377179-a9ee-457b-baa7-836554bc8506 tempest-VolumesGetTestJSON-1035823882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-54933411-bbee-4b0c-8f44-d3cb4b1bc90f req-1f377179-a9ee-457b-baa7-836554bc8506 tempest-VolumesGetTestJSON-1035823882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:07 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:51:07 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:07 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-54933411-bbee-4b0c-8f44-d3cb4b1bc90f req-1f377179-a9ee-457b-baa7-836554bc8506 tempest-VolumesGetTestJSON-1035823882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.287s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:07 devstack cinder-volume[87513]: DEBUG cinder.manager [req-54933411-bbee-4b0c-8f44-d3cb4b1bc90f req-1f377179-a9ee-457b-baa7-836554bc8506 tempest-VolumesGetTestJSON-1035823882 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:51:07 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-54933411-bbee-4b0c-8f44-d3cb4b1bc90f req-1f377179-a9ee-457b-baa7-836554bc8506 tempest-VolumesGetTestJSON-1035823882 None] Deleted volume successfully. Sep 04 15:51:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-54933411-bbee-4b0c-8f44-d3cb4b1bc90f req-1f377179-a9ee-457b-baa7-836554bc8506 tempest-VolumesGetTestJSON-1035823882 None] Lock "cinder-60277e71-d5f8-4c10-8fae-a18a4f551f65-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:08 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:51:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Flow 'volume_create_manager' (edb2e562-2394-4bf2-9827-13a6605d11f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9cffad-ca16-495f-b749-d298dd9e7d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9cffad-ca16-495f-b749-d298dd9e7d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-776911369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e01437-79b6-477d-981d-31288a0a1811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf48404a1fb443ebd0daf020947c15c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:09Z,use_quota=True,user_id='85fbd5f6fc72450e8eb97582b66be0dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fdd63d2-6e6a-489b-8bf5-b631ae963f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fdd63d2-6e6a-489b-8bf5-b631ae963f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e2cd0e-3b71-4c9a-8d90-aae31e462ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e2cd0e-3b71-4c9a-8d90-aae31e462ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73e01437-79b6-477d-981d-31288a0a1811', 'volume_name': 'volume-73e01437-79b6-477d-981d-31288a0a1811', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4aba1a7-7471-4a5e-93d7-9a8c920836b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4aba1a7-7471-4a5e-93d7-9a8c920836b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16c0e59-81b4-49ab-bd11-003f020e9c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:08 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Volume 73e01437-79b6-477d-981d-31288a0a1811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73e01437-79b6-477d-981d-31288a0a1811', 'volume_size': 1} Sep 04 15:51:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-776911369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e01437-79b6-477d-981d-31288a0a1811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf48404a1fb443ebd0daf020947c15c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:09Z,use_quota=True,user_id='85fbd5f6fc72450e8eb97582b66be0dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:51:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Creating volume 73e01437-79b6-477d-981d-31288a0a1811 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:51:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:51:09 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:51:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-73e01437-79b6-477d-981d-31288a0a1811 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:09 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-73e01437-79b6-477d-981d-31288a0a1811 1073741824 Sep 04 15:51:09 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:09 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-73e01437-79b6-477d-981d-31288a0a1811 1073741824" returned: 0 in 0.545s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-73e01437-79b6-477d-981d-31288a0a1811 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:09 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-73e01437-79b6-477d-981d-31288a0a1811 Sep 04 15:51:09 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:09 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-73e01437-79b6-477d-981d-31288a0a1811" returned: 0 in 0.278s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:09 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:51:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16c0e59-81b4-49ab-bd11-003f020e9c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73e01437-79b6-477d-981d-31288a0a1811', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c83141b-d113-48f3-a602-177be48df859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:09 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Volume volume-73e01437-79b6-477d-981d-31288a0a1811 (73e01437-79b6-477d-981d-31288a0a1811): created successfully Sep 04 15:51:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c83141b-d113-48f3-a602-177be48df859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Flow 'volume_create_manager' (edb2e562-2394-4bf2-9827-13a6605d11f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:09 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-338cfc8a-91e6-4819-8ae6-7538bbbeb684 tempest-VolumesListAdminTestJSON-2015028405 None] Created volume successfully. Sep 04 15:51:11 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:51:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Flow 'volume_create_manager' (a722fb6b-c521-4b9b-9416-bcf6f714f513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14717e46-9541-43b3-82fb-7ddddae0a91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14717e46-9541-43b3-82fb-7ddddae0a91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ce91be-56eb-4b59-aaf4-51a9509a979e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846b1865e60841229dd40943d69f9db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:12Z,use_quota=True,user_id='919c3077cc79404a89e65b8324d52791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (499eb2c5-ca35-4d42-be83-9b57a2c75dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (499eb2c5-ca35-4d42-be83-9b57a2c75dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23cf4109-1eec-40ec-be15-410dbf606e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23cf4109-1eec-40ec-be15-410dbf606e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33ce91be-56eb-4b59-aaf4-51a9509a979e', 'volume_name': 'volume-33ce91be-56eb-4b59-aaf4-51a9509a979e', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca818b1-2748-43b9-b8e4-723ddd2e0683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca818b1-2748-43b9-b8e4-723ddd2e0683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90ca073-0621-4374-ab02-e581c9080165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:12 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Volume 33ce91be-56eb-4b59-aaf4-51a9509a979e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33ce91be-56eb-4b59-aaf4-51a9509a979e', 'volume_size': 1} Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ce91be-56eb-4b59-aaf4-51a9509a979e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846b1865e60841229dd40943d69f9db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:12Z,use_quota=True,user_id='919c3077cc79404a89e65b8324d52791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Creating volume 33ce91be-56eb-4b59-aaf4-51a9509a979e {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:51:12 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-33ce91be-56eb-4b59-aaf4-51a9509a979e 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:12 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-33ce91be-56eb-4b59-aaf4-51a9509a979e 1073741824 Sep 04 15:51:12 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:12 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-33ce91be-56eb-4b59-aaf4-51a9509a979e 1073741824" returned: 0 in 0.527s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-33ce91be-56eb-4b59-aaf4-51a9509a979e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:12 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-33ce91be-56eb-4b59-aaf4-51a9509a979e Sep 04 15:51:12 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:12 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-33ce91be-56eb-4b59-aaf4-51a9509a979e" returned: 0 in 0.341s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90ca073-0621-4374-ab02-e581c9080165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33ce91be-56eb-4b59-aaf4-51a9509a979e', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d11c64-1dab-493b-96c9-e6e8f3609975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:13 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Volume volume-33ce91be-56eb-4b59-aaf4-51a9509a979e (33ce91be-56eb-4b59-aaf4-51a9509a979e): created successfully Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d11c64-1dab-493b-96c9-e6e8f3609975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Flow 'volume_create_manager' (a722fb6b-c521-4b9b-9416-bcf6f714f513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:13 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-69452a6a-e034-4d0e-9fc4-34065c2ba01d tempest-VolumesListAdminTestJSON-154632831 None] Created volume successfully. Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Flow 'volume_create_manager' (12b51f7a-3dbd-41ea-9ef1-341f4243ac6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc64d0ca-47d7-4adb-b14a-5b8c4e4e9d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc64d0ca-47d7-4adb-b14a-5b8c4e4e9d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-471715738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375933c0-70f1-45e5-8e86-06214fb8d429,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='26f704352b8b49b082ebe309e927e65f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:13Z,use_quota=True,user_id='2693a7145e32455ea24fab7c3b0063e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a01f2f-f5ef-45d6-9a15-79d6a159f558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a01f2f-f5ef-45d6-9a15-79d6a159f558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf05638-7374-4efb-9f3d-997b7e3b951c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf05638-7374-4efb-9f3d-997b7e3b951c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '375933c0-70f1-45e5-8e86-06214fb8d429', 'volume_name': 'volume-375933c0-70f1-45e5-8e86-06214fb8d429', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50421f66-48b1-4d9e-9147-900967b51461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50421f66-48b1-4d9e-9147-900967b51461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0606072-1a06-4369-9ffb-7a47d67e8306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:13 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Volume 375933c0-70f1-45e5-8e86-06214fb8d429: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-375933c0-70f1-45e5-8e86-06214fb8d429', 'volume_size': 1} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-471715738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375933c0-70f1-45e5-8e86-06214fb8d429,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='26f704352b8b49b082ebe309e927e65f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:13Z,use_quota=True,user_id='2693a7145e32455ea24fab7c3b0063e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Creating volume 375933c0-70f1-45e5-8e86-06214fb8d429 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:51:13 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375933c0-70f1-45e5-8e86-06214fb8d429 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:13 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375933c0-70f1-45e5-8e86-06214fb8d429 1073741824 Sep 04 15:51:13 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:13 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375933c0-70f1-45e5-8e86-06214fb8d429 1073741824" returned: 0 in 0.503s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375933c0-70f1-45e5-8e86-06214fb8d429 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:13 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375933c0-70f1-45e5-8e86-06214fb8d429 Sep 04 15:51:13 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:14 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375933c0-70f1-45e5-8e86-06214fb8d429" returned: 0 in 0.384s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:51:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-36e8ef71-4cdd-4311-8cab-b2e041ca18e4 tempest-VolumesListAdminTestJSON-154632831 None] Acquiring lock "cinder-33ce91be-56eb-4b59-aaf4-51a9509a979e-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0606072-1a06-4369-9ffb-7a47d67e8306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-375933c0-70f1-45e5-8e86-06214fb8d429', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af642cf6-e654-489c-8293-72ae675301d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-36e8ef71-4cdd-4311-8cab-b2e041ca18e4 tempest-VolumesListAdminTestJSON-154632831 None] Lock "cinder-33ce91be-56eb-4b59-aaf4-51a9509a979e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:14 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Volume volume-375933c0-70f1-45e5-8e86-06214fb8d429 (375933c0-70f1-45e5-8e86-06214fb8d429): created successfully Sep 04 15:51:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af642cf6-e654-489c-8293-72ae675301d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Flow 'volume_create_manager' (12b51f7a-3dbd-41ea-9ef1-341f4243ac6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:14 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-bd90a9a3-21aa-4c69-83e0-9a4f7ecd4065 tempest-VolumesTestJSON-1694999539 None] Created volume successfully. Sep 04 15:51:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-36e8ef71-4cdd-4311-8cab-b2e041ca18e4 tempest-VolumesListAdminTestJSON-154632831 None] Acquiring lock "cinder-quobyte-33ce91be-56eb-4b59-aaf4-51a9509a979e" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5e42132b-0e9d-407a-9a0a-333c7f72e2e6 tempest-VolumesListAdminTestJSON-2015028405 None] Acquiring lock "cinder-73e01437-79b6-477d-981d-31288a0a1811-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-36e8ef71-4cdd-4311-8cab-b2e041ca18e4 tempest-VolumesListAdminTestJSON-154632831 None] Lock "cinder-quobyte-33ce91be-56eb-4b59-aaf4-51a9509a979e" acquired by "delete_volume" :: waited 0.027s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5e42132b-0e9d-407a-9a0a-333c7f72e2e6 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "cinder-73e01437-79b6-477d-981d-31288a0a1811-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:14 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b13796-6d21-46da-9131-55b40d7a0960]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-36e8ef71-4cdd-4311-8cab-b2e041ca18e4 tempest-VolumesListAdminTestJSON-154632831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-33ce91be-56eb-4b59-aaf4-51a9509a979e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5e42132b-0e9d-407a-9a0a-333c7f72e2e6 tempest-VolumesListAdminTestJSON-2015028405 None] Acquiring lock "cinder-quobyte-73e01437-79b6-477d-981d-31288a0a1811" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5e42132b-0e9d-407a-9a0a-333c7f72e2e6 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "cinder-quobyte-73e01437-79b6-477d-981d-31288a0a1811" acquired by "delete_volume" :: waited 0.031s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:14 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[311d8812-a073-43c0-80e2-2afd0a846995]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5e42132b-0e9d-407a-9a0a-333c7f72e2e6 tempest-VolumesListAdminTestJSON-2015028405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-73e01437-79b6-477d-981d-31288a0a1811 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:14 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-33ce91be-56eb-4b59-aaf4-51a9509a979e Sep 04 15:51:14 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:14 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-73e01437-79b6-477d-981d-31288a0a1811 Sep 04 15:51:14 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:14 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-36e8ef71-4cdd-4311-8cab-b2e041ca18e4 tempest-VolumesListAdminTestJSON-154632831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-33ce91be-56eb-4b59-aaf4-51a9509a979e" returned: 0 in 0.442s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-36e8ef71-4cdd-4311-8cab-b2e041ca18e4 tempest-VolumesListAdminTestJSON-154632831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-33ce91be-56eb-4b59-aaf4-51a9509a979e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:14 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-33ce91be-56eb-4b59-aaf4-51a9509a979e Sep 04 15:51:14 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:15 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5e42132b-0e9d-407a-9a0a-333c7f72e2e6 tempest-VolumesListAdminTestJSON-2015028405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-73e01437-79b6-477d-981d-31288a0a1811" returned: 0 in 0.495s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5e42132b-0e9d-407a-9a0a-333c7f72e2e6 tempest-VolumesListAdminTestJSON-2015028405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-73e01437-79b6-477d-981d-31288a0a1811 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:15 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-73e01437-79b6-477d-981d-31288a0a1811 Sep 04 15:51:15 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:15 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-36e8ef71-4cdd-4311-8cab-b2e041ca18e4 tempest-VolumesListAdminTestJSON-154632831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-33ce91be-56eb-4b59-aaf4-51a9509a979e" returned: 0 in 0.310s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-36e8ef71-4cdd-4311-8cab-b2e041ca18e4 tempest-VolumesListAdminTestJSON-154632831 None] Lock "cinder-quobyte-33ce91be-56eb-4b59-aaf4-51a9509a979e" released by "delete_volume" :: held 0.813s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-36e8ef71-4cdd-4311-8cab-b2e041ca18e4 tempest-VolumesListAdminTestJSON-154632831 None] Created reservations ['05c1748d-4fb7-4e6e-941d-06d88bac9e1f', '44152770-ff70-4c73-b88b-727e9a8214ec', '1d3daeee-a7c9-4006-b939-64383b1ffed5', '05016e71-b522-47d2-8b38-4cba125ba2d6'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:51:15 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5e42132b-0e9d-407a-9a0a-333c7f72e2e6 tempest-VolumesListAdminTestJSON-2015028405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-73e01437-79b6-477d-981d-31288a0a1811" returned: 0 in 0.326s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5e42132b-0e9d-407a-9a0a-333c7f72e2e6 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "cinder-quobyte-73e01437-79b6-477d-981d-31288a0a1811" released by "delete_volume" :: held 0.885s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-36e8ef71-4cdd-4311-8cab-b2e041ca18e4 tempest-VolumesListAdminTestJSON-154632831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-36e8ef71-4cdd-4311-8cab-b2e041ca18e4 tempest-VolumesListAdminTestJSON-154632831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-36e8ef71-4cdd-4311-8cab-b2e041ca18e4 tempest-VolumesListAdminTestJSON-154632831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-36e8ef71-4cdd-4311-8cab-b2e041ca18e4 tempest-VolumesListAdminTestJSON-154632831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-36e8ef71-4cdd-4311-8cab-b2e041ca18e4 tempest-VolumesListAdminTestJSON-154632831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-36e8ef71-4cdd-4311-8cab-b2e041ca18e4 tempest-VolumesListAdminTestJSON-154632831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:15 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:51:15 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-5e42132b-0e9d-407a-9a0a-333c7f72e2e6 tempest-VolumesListAdminTestJSON-2015028405 None] Created reservations ['befe76cf-d9ef-4f35-b199-d1ab479da595', 'bc8447d0-3b0b-4153-b72d-03215f654ab9', 'a2c16b20-b8d8-4215-af75-1ccd4d5b162e', '0dfaff51-cd98-4a2b-b2e5-e9af14c98d4f'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5e42132b-0e9d-407a-9a0a-333c7f72e2e6 tempest-VolumesListAdminTestJSON-2015028405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5e42132b-0e9d-407a-9a0a-333c7f72e2e6 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5e42132b-0e9d-407a-9a0a-333c7f72e2e6 tempest-VolumesListAdminTestJSON-2015028405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5e42132b-0e9d-407a-9a0a-333c7f72e2e6 tempest-VolumesListAdminTestJSON-2015028405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5e42132b-0e9d-407a-9a0a-333c7f72e2e6 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5e42132b-0e9d-407a-9a0a-333c7f72e2e6 tempest-VolumesListAdminTestJSON-2015028405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:15 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:51:15 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:15 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-36e8ef71-4cdd-4311-8cab-b2e041ca18e4 tempest-VolumesListAdminTestJSON-154632831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.368s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-36e8ef71-4cdd-4311-8cab-b2e041ca18e4 tempest-VolumesListAdminTestJSON-154632831 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:51:15 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-36e8ef71-4cdd-4311-8cab-b2e041ca18e4 tempest-VolumesListAdminTestJSON-154632831 None] Deleted volume successfully. Sep 04 15:51:15 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-36e8ef71-4cdd-4311-8cab-b2e041ca18e4 tempest-VolumesListAdminTestJSON-154632831 None] Lock "cinder-33ce91be-56eb-4b59-aaf4-51a9509a979e-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:16 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5e42132b-0e9d-407a-9a0a-333c7f72e2e6 tempest-VolumesListAdminTestJSON-2015028405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.327s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-5e42132b-0e9d-407a-9a0a-333c7f72e2e6 tempest-VolumesListAdminTestJSON-2015028405 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:51:16 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-5e42132b-0e9d-407a-9a0a-333c7f72e2e6 tempest-VolumesListAdminTestJSON-2015028405 None] Deleted volume successfully. Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5e42132b-0e9d-407a-9a0a-333c7f72e2e6 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "cinder-73e01437-79b6-477d-981d-31288a0a1811-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Flow 'volume_create_manager' (72a97af4-4a4c-4c3d-8f20-73d17a1dbe61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953582ef-786a-413e-804e-ee780531df06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953582ef-786a-413e-804e-ee780531df06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-473682660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='26f704352b8b49b082ebe309e927e65f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:17Z,use_quota=True,user_id='2693a7145e32455ea24fab7c3b0063e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82530605-5e87-447e-92fd-166673012eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82530605-5e87-447e-92fd-166673012eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ac6846-77ce-4b80-99e5-0f6b708cd6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ac6846-77ce-4b80-99e5-0f6b708cd6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf', 'volume_name': 'volume-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b511ad-2ef8-4a44-a37f-82e0fd50c277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b511ad-2ef8-4a44-a37f-82e0fd50c277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc000170-c46b-4144-8004-8064236899a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:16 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Volume ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf', 'volume_size': 1} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-473682660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='26f704352b8b49b082ebe309e927e65f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:17Z,use_quota=True,user_id='2693a7145e32455ea24fab7c3b0063e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Creating volume ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:51:16 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:16 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf 1073741824 Sep 04 15:51:16 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bd16cfda-b6d1-4f9b-8a0a-d12a9d0dc4e2 tempest-VolumesListAdminTestJSON-2015028405 None] Acquiring lock "cinder-327d1310-8009-4644-a39e-1cce3391ee5d-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bd16cfda-b6d1-4f9b-8a0a-d12a9d0dc4e2 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "cinder-327d1310-8009-4644-a39e-1cce3391ee5d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bd16cfda-b6d1-4f9b-8a0a-d12a9d0dc4e2 tempest-VolumesListAdminTestJSON-2015028405 None] Acquiring lock "cinder-quobyte-327d1310-8009-4644-a39e-1cce3391ee5d" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bd16cfda-b6d1-4f9b-8a0a-d12a9d0dc4e2 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "cinder-quobyte-327d1310-8009-4644-a39e-1cce3391ee5d" acquired by "delete_volume" :: waited 0.023s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fdcdc0-469a-4d74-b623-92735fb13a63]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd16cfda-b6d1-4f9b-8a0a-d12a9d0dc4e2 tempest-VolumesListAdminTestJSON-2015028405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-327d1310-8009-4644-a39e-1cce3391ee5d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:17 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-327d1310-8009-4644-a39e-1cce3391ee5d Sep 04 15:51:17 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:17 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf 1073741824" returned: 0 in 0.700s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:17 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf Sep 04 15:51:17 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:17 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd16cfda-b6d1-4f9b-8a0a-d12a9d0dc4e2 tempest-VolumesListAdminTestJSON-2015028405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-327d1310-8009-4644-a39e-1cce3391ee5d" returned: 0 in 0.578s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd16cfda-b6d1-4f9b-8a0a-d12a9d0dc4e2 tempest-VolumesListAdminTestJSON-2015028405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-327d1310-8009-4644-a39e-1cce3391ee5d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:17 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-327d1310-8009-4644-a39e-1cce3391ee5d Sep 04 15:51:17 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:17 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf" returned: 0 in 0.369s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:17 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:51:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:17 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd16cfda-b6d1-4f9b-8a0a-d12a9d0dc4e2 tempest-VolumesListAdminTestJSON-2015028405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-327d1310-8009-4644-a39e-1cce3391ee5d" returned: 0 in 0.354s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:17 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc000170-c46b-4144-8004-8064236899a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:17 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (723900e2-b384-48d9-86d3-321d1c3669c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:18 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bd16cfda-b6d1-4f9b-8a0a-d12a9d0dc4e2 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "cinder-quobyte-327d1310-8009-4644-a39e-1cce3391ee5d" released by "delete_volume" :: held 1.038s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:18 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Volume volume-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf (ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf): created successfully Sep 04 15:51:18 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (723900e2-b384-48d9-86d3-321d1c3669c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:18 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Flow 'volume_create_manager' (72a97af4-4a4c-4c3d-8f20-73d17a1dbe61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:18 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-0046a772-0937-46bc-9835-44eabddb227d tempest-VolumesTestJSON-1694999539 None] Created volume successfully. Sep 04 15:51:18 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-bd16cfda-b6d1-4f9b-8a0a-d12a9d0dc4e2 tempest-VolumesListAdminTestJSON-2015028405 None] Created reservations ['2498926e-c527-4573-bc2a-0c002251c0de', '96678b8d-99a8-4744-855d-6f56c8872b8e', '9926d14d-df0a-4967-9b15-8baff90aa513', '9809eefe-903c-442f-a885-57cc1d2c3f40'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:51:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bd16cfda-b6d1-4f9b-8a0a-d12a9d0dc4e2 tempest-VolumesListAdminTestJSON-2015028405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bd16cfda-b6d1-4f9b-8a0a-d12a9d0dc4e2 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:18 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bd16cfda-b6d1-4f9b-8a0a-d12a9d0dc4e2 tempest-VolumesListAdminTestJSON-2015028405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:18 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bd16cfda-b6d1-4f9b-8a0a-d12a9d0dc4e2 tempest-VolumesListAdminTestJSON-2015028405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bd16cfda-b6d1-4f9b-8a0a-d12a9d0dc4e2 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd16cfda-b6d1-4f9b-8a0a-d12a9d0dc4e2 tempest-VolumesListAdminTestJSON-2015028405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:18 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:51:18 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:18 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd16cfda-b6d1-4f9b-8a0a-d12a9d0dc4e2 tempest-VolumesListAdminTestJSON-2015028405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.373s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:18 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bd16cfda-b6d1-4f9b-8a0a-d12a9d0dc4e2 tempest-VolumesListAdminTestJSON-2015028405 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:51:18 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-bd16cfda-b6d1-4f9b-8a0a-d12a9d0dc4e2 tempest-VolumesListAdminTestJSON-2015028405 None] Deleted volume successfully. Sep 04 15:51:18 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bd16cfda-b6d1-4f9b-8a0a-d12a9d0dc4e2 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "cinder-327d1310-8009-4644-a39e-1cce3391ee5d-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-85c51dac-c73d-494a-a914-4d297f45ad27 tempest-VolumesListAdminTestJSON-2015028405 None] Acquiring lock "cinder-0a3b40eb-9534-4496-ab79-3a9078fd5120-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-85c51dac-c73d-494a-a914-4d297f45ad27 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "cinder-0a3b40eb-9534-4496-ab79-3a9078fd5120-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-85c51dac-c73d-494a-a914-4d297f45ad27 tempest-VolumesListAdminTestJSON-2015028405 None] Acquiring lock "cinder-quobyte-0a3b40eb-9534-4496-ab79-3a9078fd5120" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-85c51dac-c73d-494a-a914-4d297f45ad27 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "cinder-quobyte-0a3b40eb-9534-4496-ab79-3a9078fd5120" acquired by "delete_volume" :: waited 0.040s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:19 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce1b457-9a84-45ef-8856-9dbae4474341]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-85c51dac-c73d-494a-a914-4d297f45ad27 tempest-VolumesListAdminTestJSON-2015028405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0a3b40eb-9534-4496-ab79-3a9078fd5120 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:19 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0a3b40eb-9534-4496-ab79-3a9078fd5120 Sep 04 15:51:19 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Flow 'volume_create_manager' (3e7cdda6-b173-4698-bfbe-c74b31fc72cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8996c311-d312-47b5-9cae-e7d2b1a208fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8996c311-d312-47b5-9cae-e7d2b1a208fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-142651890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b6f271-4434-4946-ae9f-ffdb3a1f9e74,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='26f704352b8b49b082ebe309e927e65f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:20Z,use_quota=True,user_id='2693a7145e32455ea24fab7c3b0063e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b393a1-70e1-4e68-b480-22729c3fa512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b393a1-70e1-4e68-b480-22729c3fa512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb7169f6-6166-4e4b-b1e3-4eb5e7efdadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb7169f6-6166-4e4b-b1e3-4eb5e7efdadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8b6f271-4434-4946-ae9f-ffdb3a1f9e74', 'volume_name': 'volume-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9069abe0-75b6-4851-a124-487c21b2231d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9069abe0-75b6-4851-a124-487c21b2231d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b1544ba-455f-4178-b2ff-46f7a5cc5eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:20 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Volume e8b6f271-4434-4946-ae9f-ffdb3a1f9e74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74', 'volume_size': 1} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-142651890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b6f271-4434-4946-ae9f-ffdb3a1f9e74,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='26f704352b8b49b082ebe309e927e65f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:20Z,use_quota=True,user_id='2693a7145e32455ea24fab7c3b0063e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Creating volume e8b6f271-4434-4946-ae9f-ffdb3a1f9e74 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:51:20 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:51:20 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-85c51dac-c73d-494a-a914-4d297f45ad27 tempest-VolumesListAdminTestJSON-2015028405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0a3b40eb-9534-4496-ab79-3a9078fd5120" returned: 0 in 0.653s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-85c51dac-c73d-494a-a914-4d297f45ad27 tempest-VolumesListAdminTestJSON-2015028405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0a3b40eb-9534-4496-ab79-3a9078fd5120 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:20 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74 1073741824 Sep 04 15:51:20 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:20 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0a3b40eb-9534-4496-ab79-3a9078fd5120 Sep 04 15:51:20 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:20 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-85c51dac-c73d-494a-a914-4d297f45ad27 tempest-VolumesListAdminTestJSON-2015028405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0a3b40eb-9534-4496-ab79-3a9078fd5120" returned: 0 in 0.529s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:20 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-85c51dac-c73d-494a-a914-4d297f45ad27 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "cinder-quobyte-0a3b40eb-9534-4496-ab79-3a9078fd5120" released by "delete_volume" :: held 1.284s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:21 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-85c51dac-c73d-494a-a914-4d297f45ad27 tempest-VolumesListAdminTestJSON-2015028405 None] Created reservations ['1d464d90-9f94-4fdb-8354-0c25cdd81883', '6415aba8-7207-453d-be44-471e833898c5', 'a798514c-eb71-4baf-bb22-df2fd5dabd96', '523da1f4-f3ea-4eb7-90cd-c906b54224ac'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:51:21 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74 1073741824" returned: 0 in 0.836s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-85c51dac-c73d-494a-a914-4d297f45ad27 tempest-VolumesListAdminTestJSON-2015028405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-85c51dac-c73d-494a-a914-4d297f45ad27 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:21 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-85c51dac-c73d-494a-a914-4d297f45ad27 tempest-VolumesListAdminTestJSON-2015028405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:21 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-85c51dac-c73d-494a-a914-4d297f45ad27 tempest-VolumesListAdminTestJSON-2015028405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-85c51dac-c73d-494a-a914-4d297f45ad27 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-85c51dac-c73d-494a-a914-4d297f45ad27 tempest-VolumesListAdminTestJSON-2015028405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:21 devstack sudo[90486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:51:21 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:21 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74 Sep 04 15:51:21 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:21 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74" returned: 0 in 0.333s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:21 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:51:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:21 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b1544ba-455f-4178-b2ff-46f7a5cc5eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:21 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86aca805-5cd8-4337-9a37-4d2652196c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:21 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Volume volume-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74 (e8b6f271-4434-4946-ae9f-ffdb3a1f9e74): created successfully Sep 04 15:51:21 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86aca805-5cd8-4337-9a37-4d2652196c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:21 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Flow 'volume_create_manager' (3e7cdda6-b173-4698-bfbe-c74b31fc72cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:21 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e1f14a9f-a4f6-498f-bc7a-520a0d8e2f65 tempest-VolumesTestJSON-1694999539 None] Created volume successfully. Sep 04 15:51:21 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-85c51dac-c73d-494a-a914-4d297f45ad27 tempest-VolumesListAdminTestJSON-2015028405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.503s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:21 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-85c51dac-c73d-494a-a914-4d297f45ad27 tempest-VolumesListAdminTestJSON-2015028405 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:51:21 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-85c51dac-c73d-494a-a914-4d297f45ad27 tempest-VolumesListAdminTestJSON-2015028405 None] Deleted volume successfully. Sep 04 15:51:21 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-85c51dac-c73d-494a-a914-4d297f45ad27 tempest-VolumesListAdminTestJSON-2015028405 None] Lock "cinder-0a3b40eb-9534-4496-ab79-3a9078fd5120-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-9ae117f1-7491-454a-808f-3244016f4868 req-4d3aca97-a9f6-4b2e-a27f-15637df1a200 tempest-TaggedAttachmentsTest-364679748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-9ae117f1-7491-454a-808f-3244016f4868 req-4d3aca97-a9f6-4b2e-a27f-15637df1a200 tempest-TaggedAttachmentsTest-364679748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:22 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3cf39f-f84d-4a69-89d3-c07576c68f44]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-9ae117f1-7491-454a-808f-3244016f4868 req-4d3aca97-a9f6-4b2e-a27f-15637df1a200 tempest-TaggedAttachmentsTest-364679748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ee1ab83e-97c3-45ac-8216-4814d3b59a12 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:22 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ee1ab83e-97c3-45ac-8216-4814d3b59a12 Sep 04 15:51:22 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:23 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-9ae117f1-7491-454a-808f-3244016f4868 req-4d3aca97-a9f6-4b2e-a27f-15637df1a200 tempest-TaggedAttachmentsTest-364679748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ee1ab83e-97c3-45ac-8216-4814d3b59a12" returned: 0 in 0.581s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-9ae117f1-7491-454a-808f-3244016f4868 req-4d3aca97-a9f6-4b2e-a27f-15637df1a200 tempest-TaggedAttachmentsTest-364679748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.615s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-9ae117f1-7491-454a-808f-3244016f4868 req-4d3aca97-a9f6-4b2e-a27f-15637df1a200 tempest-TaggedAttachmentsTest-364679748 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-ee1ab83e-97c3-45ac-8216-4814d3b59a12', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a2c3618-6468-4400-8df9-8ff7265ebe7a', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:51:23 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-9ae117f1-7491-454a-808f-3244016f4868 req-4d3aca97-a9f6-4b2e-a27f-15637df1a200 tempest-TaggedAttachmentsTest-364679748 None] attachment_update completed successfully. Sep 04 15:51:24 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3f048557-3e28-42db-8b06-50a94e775513 tempest-VolumesTestJSON-1694999539 None] Acquiring lock "cinder-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:24 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3f048557-3e28-42db-8b06-50a94e775513 tempest-VolumesTestJSON-1694999539 None] Lock "cinder-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:24 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3f048557-3e28-42db-8b06-50a94e775513 tempest-VolumesTestJSON-1694999539 None] Acquiring lock "cinder-quobyte-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:24 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3f048557-3e28-42db-8b06-50a94e775513 tempest-VolumesTestJSON-1694999539 None] Lock "cinder-quobyte-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74" acquired by "delete_volume" :: waited 0.053s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:24 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d90656-187b-485e-962d-051dbd78a7b8]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f048557-3e28-42db-8b06-50a94e775513 tempest-VolumesTestJSON-1694999539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:24 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74 Sep 04 15:51:24 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:24 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f048557-3e28-42db-8b06-50a94e775513 tempest-VolumesTestJSON-1694999539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74" returned: 0 in 0.516s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f048557-3e28-42db-8b06-50a94e775513 tempest-VolumesTestJSON-1694999539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:25 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74 Sep 04 15:51:25 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:25 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f048557-3e28-42db-8b06-50a94e775513 tempest-VolumesTestJSON-1694999539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74" returned: 0 in 0.393s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3f048557-3e28-42db-8b06-50a94e775513 tempest-VolumesTestJSON-1694999539 None] Lock "cinder-quobyte-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74" released by "delete_volume" :: held 1.007s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:25 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-3f048557-3e28-42db-8b06-50a94e775513 tempest-VolumesTestJSON-1694999539 None] Created reservations ['132b2719-fe18-4ce9-88f4-ef8649cb3664', '3f90ed5f-0e62-4387-9448-d67672e33b79', '2e6b5cc9-e75f-4408-b447-da2c0fcf252b', '78c9ec1c-e15e-4aa8-9dba-96eca55e8f16'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:51:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3f048557-3e28-42db-8b06-50a94e775513 tempest-VolumesTestJSON-1694999539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3f048557-3e28-42db-8b06-50a94e775513 tempest-VolumesTestJSON-1694999539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3f048557-3e28-42db-8b06-50a94e775513 tempest-VolumesTestJSON-1694999539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3f048557-3e28-42db-8b06-50a94e775513 tempest-VolumesTestJSON-1694999539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3f048557-3e28-42db-8b06-50a94e775513 tempest-VolumesTestJSON-1694999539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f048557-3e28-42db-8b06-50a94e775513 tempest-VolumesTestJSON-1694999539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:25 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:51:25 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:26 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f048557-3e28-42db-8b06-50a94e775513 tempest-VolumesTestJSON-1694999539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.414s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:26 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-3f048557-3e28-42db-8b06-50a94e775513 tempest-VolumesTestJSON-1694999539 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:51:26 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-3f048557-3e28-42db-8b06-50a94e775513 tempest-VolumesTestJSON-1694999539 None] Deleted volume successfully. Sep 04 15:51:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3f048557-3e28-42db-8b06-50a94e775513 tempest-VolumesTestJSON-1694999539 None] Lock "cinder-e8b6f271-4434-4946-ae9f-ffdb3a1f9e74-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4f4ba49c-66df-4562-8895-22d27c0b28ef tempest-VolumesTestJSON-1694999539 None] Acquiring lock "cinder-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4f4ba49c-66df-4562-8895-22d27c0b28ef tempest-VolumesTestJSON-1694999539 None] Lock "cinder-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4f4ba49c-66df-4562-8895-22d27c0b28ef tempest-VolumesTestJSON-1694999539 None] Acquiring lock "cinder-quobyte-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4f4ba49c-66df-4562-8895-22d27c0b28ef tempest-VolumesTestJSON-1694999539 None] Lock "cinder-quobyte-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf" acquired by "delete_volume" :: waited 0.068s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:26 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2f2418-b674-49c6-a165-f9cbf76d83d7]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4f4ba49c-66df-4562-8895-22d27c0b28ef tempest-VolumesTestJSON-1694999539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:27 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf Sep 04 15:51:27 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:27 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:27 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-78be2aa3-17b4-4d89-bcbc-0d25713c774f req-94373e5c-dad3-47b7-866c-836ebdf7b315 tempest-TaggedAttachmentsTest-364679748 None] Terminate volume connection completed successfully. Sep 04 15:51:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-78be2aa3-17b4-4d89-bcbc-0d25713c774f req-94373e5c-dad3-47b7-866c-836ebdf7b315 tempest-TaggedAttachmentsTest-364679748 None] Deleting attachment 6a2c3618-6468-4400-8df9-8ff7265ebe7a. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:51:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4f4ba49c-66df-4562-8895-22d27c0b28ef tempest-VolumesTestJSON-1694999539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf" returned: 0 in 0.531s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4f4ba49c-66df-4562-8895-22d27c0b28ef tempest-VolumesTestJSON-1694999539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:27 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf Sep 04 15:51:27 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:27 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4f4ba49c-66df-4562-8895-22d27c0b28ef tempest-VolumesTestJSON-1694999539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf" returned: 0 in 0.318s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4f4ba49c-66df-4562-8895-22d27c0b28ef tempest-VolumesTestJSON-1694999539 None] Lock "cinder-quobyte-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf" released by "delete_volume" :: held 0.932s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:27 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-4f4ba49c-66df-4562-8895-22d27c0b28ef tempest-VolumesTestJSON-1694999539 None] Created reservations ['9aaf9c1a-8bb4-49fd-9b1a-edf521a65d82', '5a5d8106-1e79-4d87-90eb-eb32752fa313', 'e967c383-f1b6-40ad-aa3a-f7807017b391', '0ef09a99-e12d-4544-bb01-2b94e738a78b'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:51:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4f4ba49c-66df-4562-8895-22d27c0b28ef tempest-VolumesTestJSON-1694999539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4f4ba49c-66df-4562-8895-22d27c0b28ef tempest-VolumesTestJSON-1694999539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4f4ba49c-66df-4562-8895-22d27c0b28ef tempest-VolumesTestJSON-1694999539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4f4ba49c-66df-4562-8895-22d27c0b28ef tempest-VolumesTestJSON-1694999539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4f4ba49c-66df-4562-8895-22d27c0b28ef tempest-VolumesTestJSON-1694999539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4f4ba49c-66df-4562-8895-22d27c0b28ef tempest-VolumesTestJSON-1694999539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:28 devstack sudo[91015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:51:28 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:28 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4f4ba49c-66df-4562-8895-22d27c0b28ef tempest-VolumesTestJSON-1694999539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.397s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:28 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-4f4ba49c-66df-4562-8895-22d27c0b28ef tempest-VolumesTestJSON-1694999539 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:51:28 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-4f4ba49c-66df-4562-8895-22d27c0b28ef tempest-VolumesTestJSON-1694999539 None] Deleted volume successfully. Sep 04 15:51:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4f4ba49c-66df-4562-8895-22d27c0b28ef tempest-VolumesTestJSON-1694999539 None] Lock "cinder-ad8c3a06-7f81-4da7-bba6-723cbb5f3cbf-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:29 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bd525fcc-ad38-4429-a7ba-831e97fca9eb tempest-VolumesTestJSON-1694999539 None] Acquiring lock "cinder-375933c0-70f1-45e5-8e86-06214fb8d429-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:29 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bd525fcc-ad38-4429-a7ba-831e97fca9eb tempest-VolumesTestJSON-1694999539 None] Lock "cinder-375933c0-70f1-45e5-8e86-06214fb8d429-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:29 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bd525fcc-ad38-4429-a7ba-831e97fca9eb tempest-VolumesTestJSON-1694999539 None] Acquiring lock "cinder-quobyte-375933c0-70f1-45e5-8e86-06214fb8d429" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:29 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bd525fcc-ad38-4429-a7ba-831e97fca9eb tempest-VolumesTestJSON-1694999539 None] Lock "cinder-quobyte-375933c0-70f1-45e5-8e86-06214fb8d429" acquired by "delete_volume" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:29 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf13946-12ed-4a70-a229-aa220daaf168]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd525fcc-ad38-4429-a7ba-831e97fca9eb tempest-VolumesTestJSON-1694999539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375933c0-70f1-45e5-8e86-06214fb8d429 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:29 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375933c0-70f1-45e5-8e86-06214fb8d429 Sep 04 15:51:29 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:29 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd525fcc-ad38-4429-a7ba-831e97fca9eb tempest-VolumesTestJSON-1694999539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375933c0-70f1-45e5-8e86-06214fb8d429" returned: 0 in 0.480s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd525fcc-ad38-4429-a7ba-831e97fca9eb tempest-VolumesTestJSON-1694999539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375933c0-70f1-45e5-8e86-06214fb8d429 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:29 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375933c0-70f1-45e5-8e86-06214fb8d429 Sep 04 15:51:29 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:30 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd525fcc-ad38-4429-a7ba-831e97fca9eb tempest-VolumesTestJSON-1694999539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375933c0-70f1-45e5-8e86-06214fb8d429" returned: 0 in 0.370s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bd525fcc-ad38-4429-a7ba-831e97fca9eb tempest-VolumesTestJSON-1694999539 None] Lock "cinder-quobyte-375933c0-70f1-45e5-8e86-06214fb8d429" released by "delete_volume" :: held 0.920s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:30 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-bd525fcc-ad38-4429-a7ba-831e97fca9eb tempest-VolumesTestJSON-1694999539 None] Created reservations ['0d35d88c-1d98-4b46-b1c0-6173dfaa1fb4', 'd3761eea-2466-44ee-9b7f-40439bfd6ecb', '1b21cc3c-b843-49a9-8ed1-675dc874059d', '952746ed-beb5-4c24-8d0b-b46e269158a5'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:51:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bd525fcc-ad38-4429-a7ba-831e97fca9eb tempest-VolumesTestJSON-1694999539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bd525fcc-ad38-4429-a7ba-831e97fca9eb tempest-VolumesTestJSON-1694999539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bd525fcc-ad38-4429-a7ba-831e97fca9eb tempest-VolumesTestJSON-1694999539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bd525fcc-ad38-4429-a7ba-831e97fca9eb tempest-VolumesTestJSON-1694999539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bd525fcc-ad38-4429-a7ba-831e97fca9eb tempest-VolumesTestJSON-1694999539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd525fcc-ad38-4429-a7ba-831e97fca9eb tempest-VolumesTestJSON-1694999539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:30 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:51:30 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:31 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd525fcc-ad38-4429-a7ba-831e97fca9eb tempest-VolumesTestJSON-1694999539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.532s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:31 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bd525fcc-ad38-4429-a7ba-831e97fca9eb tempest-VolumesTestJSON-1694999539 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:51:31 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-bd525fcc-ad38-4429-a7ba-831e97fca9eb tempest-VolumesTestJSON-1694999539 None] Deleted volume successfully. Sep 04 15:51:31 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bd525fcc-ad38-4429-a7ba-831e97fca9eb tempest-VolumesTestJSON-1694999539 None] Lock "cinder-375933c0-70f1-45e5-8e86-06214fb8d429-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:31 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:51:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Flow 'volume_create_manager' (6bd2ecc6-526e-4975-9e7c-c47d692b7f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be430208-7016-4ce3-a916-3e875c02e010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be430208-7016-4ce3-a916-3e875c02e010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1233291642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b905b80e-6c96-41f9-a281-b8b0cf41f684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d45f4015ab484898d6bf0501fefca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:32Z,use_quota=True,user_id='d874b01bced24d40b036e1bca847af61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16fb54fd-e918-48e9-a841-d4c1bd08abfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16fb54fd-e918-48e9-a841-d4c1bd08abfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f57870f-a77b-4c7a-ac12-06fb9cfede99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:31 devstack cinder-volume[87513]: DEBUG cinder.image.glance [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Creating Keystone auth plugin from conf {{(pid=87513) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 15:51:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f57870f-a77b-4c7a-ac12-06fb9cfede99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b905b80e-6c96-41f9-a281-b8b0cf41f684', 'volume_name': 'volume-b905b80e-6c96-41f9-a281-b8b0cf41f684', 'volume_size': 1, 'image_id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '32b22b5244654820a43b7715eda03c1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f12f0a-411c-48f1-a3c9-fcd04aafd1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f12f0a-411c-48f1-a3c9-fcd04aafd1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca5977a-2abd-4c80-9999-48d9c5a0a68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:32 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Volume b905b80e-6c96-41f9-a281-b8b0cf41f684: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b905b80e-6c96-41f9-a281-b8b0cf41f684', 'volume_size': 1, 'image_id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '32b22b5244654820a43b7715eda03c1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 15:51:32 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Trying to clone b905b80e-6c96-41f9-a281-b8b0cf41f684 from image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}]). {{(pid=87513) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 15:51:33 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_7ic6b176devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 15:51:33 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Image download 20.69 MB at 20.69 MB/s Sep 04 15:51:33 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[019e4caf-a508-4bbf-9c58-a9fb3ee6cf29]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_7ic6b176devstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:33 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_7ic6b176devstack@QuobyteHD Sep 04 15:51:33 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:34 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_7ic6b176devstack@QuobyteHD" returned: 0 in 0.528s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Temporary image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 is fetched for user d874b01bced24d40b036e1bca847af61. {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecc41ab-c4f9-4535-a91e-a5a3ec3cdff6]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_7ic6b176devstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:34 devstack sudo[91104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_7ic6b176devstack@QuobyteHD Sep 04 15:51:34 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:34 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_7ic6b176devstack@QuobyteHD" returned: 0 in 0.427s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1233291642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b905b80e-6c96-41f9-a281-b8b0cf41f684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d45f4015ab484898d6bf0501fefca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:32Z,use_quota=True,user_id='d874b01bced24d40b036e1bca847af61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Creating volume b905b80e-6c96-41f9-a281-b8b0cf41f684 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:51:34 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:34 devstack sudo[91113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 1073741824 Sep 04 15:51:34 devstack sudo[91113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:34 devstack sudo[91115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:51:34 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:35 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.301s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:51:35 devstack sudo[91113]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 1073741824" returned: 0 in 0.868s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:35 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 Sep 04 15:51:35 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:35 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684" returned: 0 in 0.309s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:51:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:35 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Attempting download of 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}])) to volume b905b80e-6c96-41f9-a281-b8b0cf41f684. {{(pid=87513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 15:51:36 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb194ca-8b63-4fcb-9ff5-fccc910690f9]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_kyppev3b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:36 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_kyppev3b Sep 04 15:51:36 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:36 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_kyppev3b" returned: 0 in 0.347s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_kyppev3b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:36 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_kyppev3b Sep 04 15:51:36 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:36 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_kyppev3b" returned: 1 in 0.463s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_kyppev3b' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:51:36 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e63a724-e517-4451-8afa-8b7190a09e6e]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_7ic6b176devstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:37 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_7ic6b176devstack@QuobyteHD Sep 04 15:51:37 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:37 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_7ic6b176devstack@QuobyteHD" returned: 0 in 0.581s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:37 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 was qcow2, converting to raw {{(pid=87513) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 15:51:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_7ic6b176devstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:37 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_7ic6b176devstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 Sep 04 15:51:37 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:39 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_7ic6b176devstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684" returned: 0 in 2.165s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:39 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_7ic6b176devstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:51:39 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Converted 112.00 MB image at 51.70 MB/s Sep 04 15:51:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:39 devstack sudo[91184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 1G Sep 04 15:51:39 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:40 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 1G" returned: 0 in 0.358s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:40 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c85e35a-456b-4680-a538-0991ab6ac3a7]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:40 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 Sep 04 15:51:40 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:40 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684" returned: 0 in 0.526s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:40 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 Sep 04 15:51:40 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-53b425de-baab-48fd-bf4a-9a121bf48d16 tempest-TaggedAttachmentsTest-364679748 None] Acquiring lock "cinder-ee1ab83e-97c3-45ac-8216-4814d3b59a12-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-53b425de-baab-48fd-bf4a-9a121bf48d16 tempest-TaggedAttachmentsTest-364679748 None] Lock "cinder-ee1ab83e-97c3-45ac-8216-4814d3b59a12-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-53b425de-baab-48fd-bf4a-9a121bf48d16 tempest-TaggedAttachmentsTest-364679748 None] Acquiring lock "cinder-quobyte-ee1ab83e-97c3-45ac-8216-4814d3b59a12" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-53b425de-baab-48fd-bf4a-9a121bf48d16 tempest-TaggedAttachmentsTest-364679748 None] Lock "cinder-quobyte-ee1ab83e-97c3-45ac-8216-4814d3b59a12" acquired by "delete_volume" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:40 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49a8356-0f34-42ae-896f-ebe083d79184]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-53b425de-baab-48fd-bf4a-9a121bf48d16 tempest-TaggedAttachmentsTest-364679748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ee1ab83e-97c3-45ac-8216-4814d3b59a12 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:41 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684" returned: 1 in 0.397s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Downloaded image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}])) to volume b905b80e-6c96-41f9-a281-b8b0cf41f684 successfully. {{(pid=87513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 15:51:41 devstack sudo[91201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ee1ab83e-97c3-45ac-8216-4814d3b59a12 Sep 04 15:51:41 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Temporary image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 for user d874b01bced24d40b036e1bca847af61 is deleted. {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Marking volume b905b80e-6c96-41f9-a281-b8b0cf41f684 as bootable. {{(pid=87513) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Copying metadata from image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 to b905b80e-6c96-41f9-a281-b8b0cf41f684. {{(pid=87513) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Creating volume glance metadata for volume b905b80e-6c96-41f9-a281-b8b0cf41f684 backed by image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87513) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca5977a-2abd-4c80-9999-48d9c5a0a68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b905b80e-6c96-41f9-a281-b8b0cf41f684', 'volume_size': 1, 'image_id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '32b22b5244654820a43b7715eda03c1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7154e520-f977-4fa8-887c-b0d1a5c95341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:41 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Volume volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 (b905b80e-6c96-41f9-a281-b8b0cf41f684): created successfully Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7154e520-f977-4fa8-887c-b0d1a5c95341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Flow 'volume_create_manager' (6bd2ecc6-526e-4975-9e7c-c47d692b7f5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:41 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e7273fff-3aa6-456f-b8ea-831314d7a4dc tempest-VolumesImageMetadata-1542884720 None] Created volume successfully. Sep 04 15:51:41 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-53b425de-baab-48fd-bf4a-9a121bf48d16 tempest-TaggedAttachmentsTest-364679748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ee1ab83e-97c3-45ac-8216-4814d3b59a12" returned: 0 in 0.365s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-53b425de-baab-48fd-bf4a-9a121bf48d16 tempest-TaggedAttachmentsTest-364679748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ee1ab83e-97c3-45ac-8216-4814d3b59a12 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:41 devstack sudo[91210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ee1ab83e-97c3-45ac-8216-4814d3b59a12 Sep 04 15:51:41 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:41 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-53b425de-baab-48fd-bf4a-9a121bf48d16 tempest-TaggedAttachmentsTest-364679748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ee1ab83e-97c3-45ac-8216-4814d3b59a12" returned: 0 in 0.246s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-53b425de-baab-48fd-bf4a-9a121bf48d16 tempest-TaggedAttachmentsTest-364679748 None] Lock "cinder-quobyte-ee1ab83e-97c3-45ac-8216-4814d3b59a12" released by "delete_volume" :: held 0.657s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-53b425de-baab-48fd-bf4a-9a121bf48d16 tempest-TaggedAttachmentsTest-364679748 None] Created reservations ['41ea6093-08b0-40e6-b881-f6aec8ef692c', '73479f5e-3045-4ce5-b17e-29f887f0f88c', 'bc83e093-1e8e-4c29-a429-5ffe77ee7353', '8d531ade-965b-455b-943d-9bd9ac1c5161'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-53b425de-baab-48fd-bf4a-9a121bf48d16 tempest-TaggedAttachmentsTest-364679748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-53b425de-baab-48fd-bf4a-9a121bf48d16 tempest-TaggedAttachmentsTest-364679748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-53b425de-baab-48fd-bf4a-9a121bf48d16 tempest-TaggedAttachmentsTest-364679748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-53b425de-baab-48fd-bf4a-9a121bf48d16 tempest-TaggedAttachmentsTest-364679748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-53b425de-baab-48fd-bf4a-9a121bf48d16 tempest-TaggedAttachmentsTest-364679748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-53b425de-baab-48fd-bf4a-9a121bf48d16 tempest-TaggedAttachmentsTest-364679748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:41 devstack sudo[91213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:51:41 devstack sudo[91213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:41 devstack sudo[91213]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-53b425de-baab-48fd-bf4a-9a121bf48d16 tempest-TaggedAttachmentsTest-364679748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.275s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-53b425de-baab-48fd-bf4a-9a121bf48d16 tempest-TaggedAttachmentsTest-364679748 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:51:41 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-53b425de-baab-48fd-bf4a-9a121bf48d16 tempest-TaggedAttachmentsTest-364679748 None] Deleted volume successfully. Sep 04 15:51:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-53b425de-baab-48fd-bf4a-9a121bf48d16 tempest-TaggedAttachmentsTest-364679748 None] Lock "cinder-ee1ab83e-97c3-45ac-8216-4814d3b59a12-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] Acquiring lock "cinder-b905b80e-6c96-41f9-a281-b8b0cf41f684-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] Lock "cinder-b905b80e-6c96-41f9-a281-b8b0cf41f684-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] Acquiring lock "cinder-quobyte-b905b80e-6c96-41f9-a281-b8b0cf41f684" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] Lock "cinder-quobyte-b905b80e-6c96-41f9-a281-b8b0cf41f684" acquired by "delete_volume" :: waited 0.021s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:42 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[da566751-f51a-4de0-8de9-b895a0f6f1b4]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:42 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 Sep 04 15:51:42 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:42 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684" returned: 0 in 0.373s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:42 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 Sep 04 15:51:42 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:42 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ee81d20a-4402-4cc2-8d99-b3038b40f0fa tempest-GroupsV314Test-379251439 None] Group tempest-GroupsV314Test-Group-1973345198: creating Sep 04 15:51:42 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ee81d20a-4402-4cc2-8d99-b3038b40f0fa tempest-GroupsV314Test-379251439 None] Group tempest-GroupsV314Test-Group-1973345198: created successfully Sep 04 15:51:42 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ee81d20a-4402-4cc2-8d99-b3038b40f0fa tempest-GroupsV314Test-379251439 None] Create group completed successfully. Sep 04 15:51:42 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684" returned: 1 in 0.403s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:51:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:42 devstack sudo[91225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684 Sep 04 15:51:42 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:43 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b905b80e-6c96-41f9-a281-b8b0cf41f684" returned: 0 in 0.258s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] Lock "cinder-quobyte-b905b80e-6c96-41f9-a281-b8b0cf41f684" released by "delete_volume" :: held 1.099s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:43 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] Created reservations ['2c3d5919-4999-4a78-b896-c266aaed92cc', 'd6593a6b-132d-4b4f-9e9c-ca63c8c242a8', 'e795a209-ae5a-47f7-8d54-179b85bd5e1a', '63a5c66a-838e-457a-b738-f170f11503e4'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:51:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:43 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:51:43 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:43 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.243s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:43 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:51:43 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] Deleted volume successfully. Sep 04 15:51:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e26ac96f-2326-443b-953e-40974a12cd33 tempest-VolumesImageMetadata-1542884720 None] Lock "cinder-b905b80e-6c96-41f9-a281-b8b0cf41f684-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Flow 'volume_create_manager' (1bb5d5e8-0b06-4ef1-8c9a-8a93e89c037d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14924254-e5b9-41a5-b602-d7c7d5566a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14924254-e5b9-41a5-b602-d7c7d5566a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1943439014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=868b0b97-348e-4a5e-a444-b89cd567d52c,host='devstack@QuobyteHD#QuobyteHD',id=db1d52a6-bcba-4842-b6ad-b0801003f2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9374c3f59c45bf966deea64b109689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:44Z,use_quota=True,user_id='fec7c14ba67c4044ad3c754e82f6607e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4499c25-a10b-4f08-8b97-f6d00b3daadd),volume_type_id=c4499c25-a10b-4f08-8b97-f6d00b3daadd)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d0a70cb-d531-4cce-b303-6ec25ecc1360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d0a70cb-d531-4cce-b303-6ec25ecc1360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (513dd8bc-1310-4000-bc43-9fa7e8a3f8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (513dd8bc-1310-4000-bc43-9fa7e8a3f8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db1d52a6-bcba-4842-b6ad-b0801003f2ef', 'volume_name': 'volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80337e7d-3eca-4cdd-aac9-c5ec8c874789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80337e7d-3eca-4cdd-aac9-c5ec8c874789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec893fa-af7e-4c6b-934d-31a6f14e194c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:44 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Volume db1d52a6-bcba-4842-b6ad-b0801003f2ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef', 'volume_size': 1} Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=868b0b97-348e-4a5e-a444-b89cd567d52c,created_at=2026-09-04T13:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1943439014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=868b0b97-348e-4a5e-a444-b89cd567d52c,host='devstack@QuobyteHD#QuobyteHD',id=db1d52a6-bcba-4842-b6ad-b0801003f2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9374c3f59c45bf966deea64b109689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:44Z,use_quota=True,user_id='fec7c14ba67c4044ad3c754e82f6607e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4499c25-a10b-4f08-8b97-f6d00b3daadd),volume_type_id=c4499c25-a10b-4f08-8b97-f6d00b3daadd)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Creating volume db1d52a6-bcba-4842-b6ad-b0801003f2ef {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:51:44 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:51:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:44 devstack sudo[91235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef 1073741824 Sep 04 15:51:44 devstack sudo[91235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:45 devstack sudo[91235]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef 1073741824" returned: 0 in 0.450s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:45 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef Sep 04 15:51:45 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:45 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef" returned: 0 in 0.255s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:51:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec893fa-af7e-4c6b-934d-31a6f14e194c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc44977-2b5c-441a-965e-828930d10a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:45 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Volume volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef (db1d52a6-bcba-4842-b6ad-b0801003f2ef): created successfully Sep 04 15:51:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc44977-2b5c-441a-965e-828930d10a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Flow 'volume_create_manager' (1bb5d5e8-0b06-4ef1-8c9a-8a93e89c037d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:45 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ed0b7d13-4f87-48a6-a6a0-aec55c7c42e3 tempest-GroupsV314Test-379251439 None] Created volume successfully. Sep 04 15:51:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:46 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Cloning volume db1d52a6-bcba-4842-b6ad-b0801003f2ef to volume 1491d4d4-00ee-4503-a05c-be951391010b Sep 04 15:51:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Creating offline snapshot d89b8613-d18d-485d-85d4-b1c27b3d66db of volume db1d52a6-bcba-4842-b6ad-b0801003f2ef {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:51:46 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f557b939-3e16-47b1-8e28-f393b9fb31a6]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:46 devstack sudo[91244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef Sep 04 15:51:46 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:47 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef" returned: 0 in 0.567s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:47 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db 1G Sep 04 15:51:47 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:47 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db 1G" returned: 0 in 0.574s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:47 devstack sudo[91257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db Sep 04 15:51:47 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:48 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db" returned: 0 in 0.321s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:48 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db is being set with open permissions: ugo+rw: NotImplementedError Sep 04 15:51:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:48 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db Sep 04 15:51:48 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:48 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db" returned: 0 in 0.331s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:48 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.info Sep 04 15:51:48 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:49 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.info" returned: 0 in 0.350s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:49 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 15:51:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:49 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.info Sep 04 15:51:49 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:49 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.info" returned: 0 in 0.298s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:49 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Acquiring lock "cinder-quobyte-1491d4d4-00ee-4503-a05c-be951391010b" by "_copy_volume_from_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:49 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Lock "cinder-quobyte-1491d4d4-00ee-4503-a05c-be951391010b" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:49 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] snapshot: d89b8613-d18d-485d-85d4-b1c27b3d66db, volume: 1491d4d4-00ee-4503-a05c-be951391010b, {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 04 15:51:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:49 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:49 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:49 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5610ea-6fd0-400d-90f2-cbb60f6d92ea]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:49 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db Sep 04 15:51:49 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:49 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db" returned: 0 in 0.451s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:49 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:51:49 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] will copy from snapshot at /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 04 15:51:49 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Creating direct copy from snapshot {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 04 15:51:49 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bf9366-1a35-4be0-ae04-3141e2b515e2]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:49 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef Sep 04 15:51:49 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:50 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef" returned: 0 in 0.389s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:50 devstack cinder-volume[87513]: DEBUG cinder.utils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Path /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1491d4d4-00ee-4503-a05c-be951391010b not found in is_blk_device check {{(pid=87513) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 04 15:51:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1491d4d4-00ee-4503-a05c-be951391010b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:50 devstack sudo[91283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1491d4d4-00ee-4503-a05c-be951391010b Sep 04 15:51:50 devstack sudo[91283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:51 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:51:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Flow 'volume_create_manager' (fd7d38a3-db6f-4652-beb2-4e2942de6021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc44762-8b43-4ae2-a4c6-e3f3ae519fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc44762-8b43-4ae2-a4c6-e3f3ae519fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-74888099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c06fc5-e0eb-4221-ad95-5ce449664e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4473cf8278427491dc449288f4f3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:52Z,use_quota=True,user_id='f2f3cf1481174beeb6400d2c2b485df6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59250233-6974-4883-af8f-bf781615e7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59250233-6974-4883-af8f-bf781615e7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7398dafb-2b27-4eac-a5a5-a3e29d3faaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7398dafb-2b27-4eac-a5a5-a3e29d3faaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66c06fc5-e0eb-4221-ad95-5ce449664e1b', 'volume_name': 'volume-66c06fc5-e0eb-4221-ad95-5ce449664e1b', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e9dce3-2fb3-459f-9388-511a0b0a7891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e9dce3-2fb3-459f-9388-511a0b0a7891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (307353ae-605a-484c-8558-b9922abf088a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:51 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Volume 66c06fc5-e0eb-4221-ad95-5ce449664e1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66c06fc5-e0eb-4221-ad95-5ce449664e1b', 'volume_size': 1} Sep 04 15:51:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:52 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:51:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Flow 'volume_create_manager' (69fe2b58-649c-493e-91b3-5a9b4db99504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e063ac6-3550-4b74-89c6-729777b35686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e063ac6-3550-4b74-89c6-729777b35686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2120193497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5307513d-53d2-44f2-8bd9-d10ed829cb9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e61dde69fa204bddbb1ecac848592801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:52Z,use_quota=True,user_id='830fc12a045e482fb68d1b4b13386f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23381024-7c96-44db-9cc6-968d0bc16c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23381024-7c96-44db-9cc6-968d0bc16c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3ad3f4-ba52-486e-880b-c3fc8052dc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3ad3f4-ba52-486e-880b-c3fc8052dc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5307513d-53d2-44f2-8bd9-d10ed829cb9e', 'volume_name': 'volume-5307513d-53d2-44f2-8bd9-d10ed829cb9e', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62120328-577b-4024-8b65-a26024849e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62120328-577b-4024-8b65-a26024849e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a38f54b-cc69-4a03-b48a-92e9b31d5f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:52 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Volume 5307513d-53d2-44f2-8bd9-d10ed829cb9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5307513d-53d2-44f2-8bd9-d10ed829cb9e', 'volume_size': 1} Sep 04 15:51:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:55 devstack sudo[91283]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1491d4d4-00ee-4503-a05c-be951391010b" returned: 0 in 5.544s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:55 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc63a2fa-7528-49b0-8ae8-e6f5e34a20d3]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:55 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef Sep 04 15:51:55 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:56 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef" returned: 0 in 0.547s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:56 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Image conversion details: src /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1491d4d4-00ee-4503-a05c-be951391010b {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:51:56 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Converted 1024.00 MB image at 184.68 MB/s Sep 04 15:51:56 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1491d4d4-00ee-4503-a05c-be951391010b is being set with open permissions: ugo+rw: NotImplementedError Sep 04 15:51:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1491d4d4-00ee-4503-a05c-be951391010b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:56 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1491d4d4-00ee-4503-a05c-be951391010b Sep 04 15:51:56 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:56 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1491d4d4-00ee-4503-a05c-be951391010b" returned: 0 in 0.260s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Lock "cinder-quobyte-1491d4d4-00ee-4503-a05c-be951391010b" released by "_copy_volume_from_snapshot" :: held 7.275s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Acquiring lock "cinder-quobyte-d89b8613-d18d-485d-85d4-b1c27b3d66db" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Lock "cinder-quobyte-d89b8613-d18d-485d-85d4-b1c27b3d66db" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Deleting offline snapshot d89b8613-d18d-485d-85d4-b1c27b3d66db of volume db1d52a6-bcba-4842-b6ad-b0801003f2ef {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:51:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] snapshot_file for this snap is: volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:51:56 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc4c73e-9b4a-412f-be1d-4413310a0576]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:56 devstack sudo[91323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db Sep 04 15:51:56 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:57 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db" returned: 0 in 0.372s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:51:57 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc416257-7124-4fc3-b48e-31a8141661fc]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:57 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef Sep 04 15:51:57 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:57 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef" returned: 0 in 0.365s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:57 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db Sep 04 15:51:57 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:57 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db" returned: 0 in 0.350s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:57 devstack sudo[91339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db Sep 04 15:51:57 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:58 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef.d89b8613-d18d-485d-85d4-b1c27b3d66db" returned: 0 in 0.268s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:58 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Lock "cinder-quobyte-d89b8613-d18d-485d-85d4-b1c27b3d66db" released by "_delete_snapshot" :: held 1.446s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.447s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.173s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-74888099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c06fc5-e0eb-4221-ad95-5ce449664e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4473cf8278427491dc449288f4f3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:52Z,use_quota=True,user_id='f2f3cf1481174beeb6400d2c2b485df6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:51:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Creating volume 66c06fc5-e0eb-4221-ad95-5ce449664e1b {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:51:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:51:58 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:51:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-66c06fc5-e0eb-4221-ad95-5ce449664e1b 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:58 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-66c06fc5-e0eb-4221-ad95-5ce449664e1b 1073741824 Sep 04 15:51:58 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:58 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-1f3bc7e3-0fd0-47b9-905b-e05fa9207678 tempest-GroupsV314Test-379251439 None] Create group from source-group-868b0b97-348e-4a5e-a444-b89cd567d52c completed successfully. Sep 04 15:51:58 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-66c06fc5-e0eb-4221-ad95-5ce449664e1b 1073741824" returned: 0 in 0.508s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:58 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=91,cinder:UPDATE=114,cinder:INSERT=38,cinder:DELETE=10 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:51:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-66c06fc5-e0eb-4221-ad95-5ce449664e1b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:58 devstack sudo[91382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-66c06fc5-e0eb-4221-ad95-5ce449664e1b Sep 04 15:51:58 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:59 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-66c06fc5-e0eb-4221-ad95-5ce449664e1b" returned: 0 in 0.301s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.427s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2120193497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5307513d-53d2-44f2-8bd9-d10ed829cb9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e61dde69fa204bddbb1ecac848592801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:52Z,use_quota=True,user_id='830fc12a045e482fb68d1b4b13386f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Creating volume 5307513d-53d2-44f2-8bd9-d10ed829cb9e {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:51:59 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5307513d-53d2-44f2-8bd9-d10ed829cb9e 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=128,cinder:SELECT=100,cinder:INSERT=28,cinder:DELETE=10 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (307353ae-605a-484c-8558-b9922abf088a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66c06fc5-e0eb-4221-ad95-5ce449664e1b', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c7746d9-24fe-4a7b-8c71-2a29658a5605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:59 devstack sudo[91387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5307513d-53d2-44f2-8bd9-d10ed829cb9e 1073741824 Sep 04 15:51:59 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:59 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Volume volume-66c06fc5-e0eb-4221-ad95-5ce449664e1b (66c06fc5-e0eb-4221-ad95-5ce449664e1b): created successfully Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c7746d9-24fe-4a7b-8c71-2a29658a5605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Flow 'volume_create_manager' (fd7d38a3-db6f-4652-beb2-4e2942de6021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:59 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-5806e815-adeb-4429-bb68-f32452fde586 tempest-AttachVolumeShelveTestJSON-2130397730 None] Created volume successfully. Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ef320d6e-e897-4e70-82a9-cdc6ca925224 tempest-GroupsV314Test-379251439 None] Acquiring lock "cinder-quobyte-1491d4d4-00ee-4503-a05c-be951391010b" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ef320d6e-e897-4e70-82a9-cdc6ca925224 tempest-GroupsV314Test-379251439 None] Lock "cinder-quobyte-1491d4d4-00ee-4503-a05c-be951391010b" acquired by "delete_volume" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c18b0a-6bba-4605-81b0-6436ea2d8e51]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef320d6e-e897-4e70-82a9-cdc6ca925224 tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1491d4d4-00ee-4503-a05c-be951391010b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:59 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1491d4d4-00ee-4503-a05c-be951391010b Sep 04 15:51:59 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:59 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5307513d-53d2-44f2-8bd9-d10ed829cb9e 1073741824" returned: 0 in 0.571s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5307513d-53d2-44f2-8bd9-d10ed829cb9e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:59 devstack sudo[91395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5307513d-53d2-44f2-8bd9-d10ed829cb9e Sep 04 15:51:59 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:59 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef320d6e-e897-4e70-82a9-cdc6ca925224 tempest-GroupsV314Test-379251439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1491d4d4-00ee-4503-a05c-be951391010b" returned: 0 in 0.409s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef320d6e-e897-4e70-82a9-cdc6ca925224 tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1491d4d4-00ee-4503-a05c-be951391010b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:59 devstack sudo[91400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1491d4d4-00ee-4503-a05c-be951391010b Sep 04 15:51:59 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:59 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5307513d-53d2-44f2-8bd9-d10ed829cb9e" returned: 0 in 0.279s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a38f54b-cc69-4a03-b48a-92e9b31d5f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5307513d-53d2-44f2-8bd9-d10ed829cb9e', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130aa903-9ae8-43f2-8011-b4834368f081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:00 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Volume volume-5307513d-53d2-44f2-8bd9-d10ed829cb9e (5307513d-53d2-44f2-8bd9-d10ed829cb9e): created successfully Sep 04 15:52:00 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130aa903-9ae8-43f2-8011-b4834368f081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:00 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Flow 'volume_create_manager' (69fe2b58-649c-493e-91b3-5a9b4db99504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:52:00 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b2e8ba1c-8d34-4c7d-8ab4-2d61c7db2d07 tempest-VolumesMetadataTest-980036538 None] Created volume successfully. Sep 04 15:52:00 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef320d6e-e897-4e70-82a9-cdc6ca925224 tempest-GroupsV314Test-379251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1491d4d4-00ee-4503-a05c-be951391010b" returned: 0 in 0.278s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ef320d6e-e897-4e70-82a9-cdc6ca925224 tempest-GroupsV314Test-379251439 None] Lock "cinder-quobyte-1491d4d4-00ee-4503-a05c-be951391010b" released by "delete_volume" :: held 0.740s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:52:00 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-ef320d6e-e897-4e70-82a9-cdc6ca925224 tempest-GroupsV314Test-379251439 None] Created reservations ['0d09e14c-3c11-4dca-9e90-8ec60c9e517f'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:52:00 devstack cinder-volume[87513]: WARNING cinder.quota [None req-ef320d6e-e897-4e70-82a9-cdc6ca925224 tempest-GroupsV314Test-379251439 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-228630933 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-228630933, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:52:00 devstack cinder-volume[87513]: WARNING cinder.quota [None req-ef320d6e-e897-4e70-82a9-cdc6ca925224 tempest-GroupsV314Test-379251439 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-228630933 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-228630933, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:52:00 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-ef320d6e-e897-4e70-82a9-cdc6ca925224 tempest-GroupsV314Test-379251439 None] Created reservations ['24592cf8-87a2-45df-aab1-8b1f729f3ec7', '64994bcf-f938-46c6-bd44-307ee8c02bf2', '33a2068a-bc29-48bb-afe6-fd186d6c2b9f', 'abc2b29d-1b5f-4165-ab72-46dd89e4c722'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:52:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ef320d6e-e897-4e70-82a9-cdc6ca925224 tempest-GroupsV314Test-379251439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ef320d6e-e897-4e70-82a9-cdc6ca925224 tempest-GroupsV314Test-379251439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:00 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ef320d6e-e897-4e70-82a9-cdc6ca925224 tempest-GroupsV314Test-379251439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:52:00 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ef320d6e-e897-4e70-82a9-cdc6ca925224 tempest-GroupsV314Test-379251439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:52:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ef320d6e-e897-4e70-82a9-cdc6ca925224 tempest-GroupsV314Test-379251439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef320d6e-e897-4e70-82a9-cdc6ca925224 tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:00 devstack sudo[91408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:52:00 devstack sudo[91408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:00 devstack sudo[91408]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef320d6e-e897-4e70-82a9-cdc6ca925224 tempest-GroupsV314Test-379251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.328s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:00 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-ef320d6e-e897-4e70-82a9-cdc6ca925224 tempest-GroupsV314Test-379251439 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:52:00 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ef320d6e-e897-4e70-82a9-cdc6ca925224 tempest-GroupsV314Test-379251439 None] Delete group completed successfully. Sep 04 15:52:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-45a3f1bb-3235-40d4-9be1-2f2cd686418d tempest-GroupsV314Test-379251439 None] Acquiring lock "cinder-quobyte-db1d52a6-bcba-4842-b6ad-b0801003f2ef" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:52:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-45a3f1bb-3235-40d4-9be1-2f2cd686418d tempest-GroupsV314Test-379251439 None] Lock "cinder-quobyte-db1d52a6-bcba-4842-b6ad-b0801003f2ef" acquired by "delete_volume" :: waited 0.030s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:52:01 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bcfedb-2d23-414f-9264-9ec02b9e2c35]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:52:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-45a3f1bb-3235-40d4-9be1-2f2cd686418d tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:01 devstack sudo[91411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef Sep 04 15:52:01 devstack sudo[91411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:01 devstack sudo[91411]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-45a3f1bb-3235-40d4-9be1-2f2cd686418d tempest-GroupsV314Test-379251439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef" returned: 0 in 0.465s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-45a3f1bb-3235-40d4-9be1-2f2cd686418d tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:01 devstack sudo[91416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef Sep 04 15:52:01 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:01 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-45a3f1bb-3235-40d4-9be1-2f2cd686418d tempest-GroupsV314Test-379251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db1d52a6-bcba-4842-b6ad-b0801003f2ef" returned: 0 in 0.448s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:02 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-45a3f1bb-3235-40d4-9be1-2f2cd686418d tempest-GroupsV314Test-379251439 None] Lock "cinder-quobyte-db1d52a6-bcba-4842-b6ad-b0801003f2ef" released by "delete_volume" :: held 1.020s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:52:02 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-03a05a86-bd8d-4f04-8c0e-49cd79cffac8 tempest-VolumesMetadataTest-980036538 None] Acquiring lock "cinder-5307513d-53d2-44f2-8bd9-d10ed829cb9e-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:52:02 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-03a05a86-bd8d-4f04-8c0e-49cd79cffac8 tempest-VolumesMetadataTest-980036538 None] Lock "cinder-5307513d-53d2-44f2-8bd9-d10ed829cb9e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:52:02 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-45a3f1bb-3235-40d4-9be1-2f2cd686418d tempest-GroupsV314Test-379251439 None] Created reservations ['d0dc600e-5d4f-45a8-a885-81a4de94fb84'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:52:02 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-03a05a86-bd8d-4f04-8c0e-49cd79cffac8 tempest-VolumesMetadataTest-980036538 None] Acquiring lock "cinder-quobyte-5307513d-53d2-44f2-8bd9-d10ed829cb9e" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:52:02 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-03a05a86-bd8d-4f04-8c0e-49cd79cffac8 tempest-VolumesMetadataTest-980036538 None] Lock "cinder-quobyte-5307513d-53d2-44f2-8bd9-d10ed829cb9e" acquired by "delete_volume" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:52:02 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d5074c-f138-44e6-8a1c-b1be13ab3521]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:52:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-03a05a86-bd8d-4f04-8c0e-49cd79cffac8 tempest-VolumesMetadataTest-980036538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5307513d-53d2-44f2-8bd9-d10ed829cb9e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:02 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-45a3f1bb-3235-40d4-9be1-2f2cd686418d tempest-GroupsV314Test-379251439 None] Created reservations ['9aea1c1e-51a4-4d8a-8e2e-f47116dbbcf5', 'aa4f4c6a-0af3-490b-b27b-aacfbed1fa67', 'cdff9629-8edf-423f-8d6d-ab8c3acbc3f6', '5ce99d90-608c-476b-9a89-5f0877459021'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:52:02 devstack sudo[91425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5307513d-53d2-44f2-8bd9-d10ed829cb9e Sep 04 15:52:02 devstack sudo[91425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-45a3f1bb-3235-40d4-9be1-2f2cd686418d tempest-GroupsV314Test-379251439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-45a3f1bb-3235-40d4-9be1-2f2cd686418d tempest-GroupsV314Test-379251439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-45a3f1bb-3235-40d4-9be1-2f2cd686418d tempest-GroupsV314Test-379251439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:52:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-45a3f1bb-3235-40d4-9be1-2f2cd686418d tempest-GroupsV314Test-379251439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:52:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-45a3f1bb-3235-40d4-9be1-2f2cd686418d tempest-GroupsV314Test-379251439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-45a3f1bb-3235-40d4-9be1-2f2cd686418d tempest-GroupsV314Test-379251439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:02 devstack sudo[91427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:52:02 devstack sudo[91427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:02 devstack sudo[91425]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-03a05a86-bd8d-4f04-8c0e-49cd79cffac8 tempest-VolumesMetadataTest-980036538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5307513d-53d2-44f2-8bd9-d10ed829cb9e" returned: 0 in 0.485s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-03a05a86-bd8d-4f04-8c0e-49cd79cffac8 tempest-VolumesMetadataTest-980036538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5307513d-53d2-44f2-8bd9-d10ed829cb9e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:02 devstack sudo[91442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5307513d-53d2-44f2-8bd9-d10ed829cb9e Sep 04 15:52:02 devstack sudo[91442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:02 devstack sudo[91427]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-45a3f1bb-3235-40d4-9be1-2f2cd686418d tempest-GroupsV314Test-379251439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.317s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:02 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-45a3f1bb-3235-40d4-9be1-2f2cd686418d tempest-GroupsV314Test-379251439 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:52:02 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-45a3f1bb-3235-40d4-9be1-2f2cd686418d tempest-GroupsV314Test-379251439 None] Delete group completed successfully. Sep 04 15:52:03 devstack sudo[91442]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-03a05a86-bd8d-4f04-8c0e-49cd79cffac8 tempest-VolumesMetadataTest-980036538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5307513d-53d2-44f2-8bd9-d10ed829cb9e" returned: 0 in 0.285s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-03a05a86-bd8d-4f04-8c0e-49cd79cffac8 tempest-VolumesMetadataTest-980036538 None] Lock "cinder-quobyte-5307513d-53d2-44f2-8bd9-d10ed829cb9e" released by "delete_volume" :: held 0.835s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:52:03 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-03a05a86-bd8d-4f04-8c0e-49cd79cffac8 tempest-VolumesMetadataTest-980036538 None] Created reservations ['cd83fe8a-23e0-4e60-98df-6e193a1e1027', '163c7e38-bf68-4d2f-afde-814fb2e4d191', '2d620491-fa83-4fb2-8187-884a73583a4f', 'a1f5a858-84fb-474a-858f-dcdf679bec85'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:52:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-03a05a86-bd8d-4f04-8c0e-49cd79cffac8 tempest-VolumesMetadataTest-980036538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-03a05a86-bd8d-4f04-8c0e-49cd79cffac8 tempest-VolumesMetadataTest-980036538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-03a05a86-bd8d-4f04-8c0e-49cd79cffac8 tempest-VolumesMetadataTest-980036538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:52:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-03a05a86-bd8d-4f04-8c0e-49cd79cffac8 tempest-VolumesMetadataTest-980036538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:52:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-03a05a86-bd8d-4f04-8c0e-49cd79cffac8 tempest-VolumesMetadataTest-980036538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-03a05a86-bd8d-4f04-8c0e-49cd79cffac8 tempest-VolumesMetadataTest-980036538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:03 devstack sudo[91445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:52:03 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:03 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-03a05a86-bd8d-4f04-8c0e-49cd79cffac8 tempest-VolumesMetadataTest-980036538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.353s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:03 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-03a05a86-bd8d-4f04-8c0e-49cd79cffac8 tempest-VolumesMetadataTest-980036538 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:52:03 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-03a05a86-bd8d-4f04-8c0e-49cd79cffac8 tempest-VolumesMetadataTest-980036538 None] Deleted volume successfully. Sep 04 15:52:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-03a05a86-bd8d-4f04-8c0e-49cd79cffac8 tempest-VolumesMetadataTest-980036538 None] Lock "cinder-5307513d-53d2-44f2-8bd9-d10ed829cb9e-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Flow 'volume_create_manager' (98a7570f-157b-4934-b845-f9122238ae06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73586684-b34e-4264-adbd-6bbaea2c346a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73586684-b34e-4264-adbd-6bbaea2c346a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1911121841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27449fba62d2423bad67bbf598ad65d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:11Z,use_quota=True,user_id='f2e5a89138214c168bf7a6393c4080e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08799af-15d0-4e30-9f3f-9061366ff00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08799af-15d0-4e30-9f3f-9061366ff00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed03e2db-38bc-417a-acfb-5c069cdf6445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed03e2db-38bc-417a-acfb-5c069cdf6445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9', 'volume_name': 'volume-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9', 'volume_size': 2}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3a1206-3282-4d4f-be03-ee23d592c606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3a1206-3282-4d4f-be03-ee23d592c606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f19ee5-f422-4442-86a9-b54705bf03c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:11 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Volume d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9', 'volume_size': 2} Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1911121841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27449fba62d2423bad67bbf598ad65d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:11Z,use_quota=True,user_id='f2e5a89138214c168bf7a6393c4080e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Creating volume d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:52:11 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:52:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9 2147483648 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:11 devstack sudo[91454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9 2147483648 Sep 04 15:52:11 devstack sudo[91454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:12 devstack sudo[91454]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9 2147483648" returned: 0 in 0.875s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:12 devstack sudo[91478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9 Sep 04 15:52:12 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:12 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9" returned: 0 in 0.300s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:52:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f19ee5-f422-4442-86a9-b54705bf03c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9', 'volume_size': 2}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18748a7a-db08-48f6-8c95-ac524cac0f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:12 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Volume volume-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9 (d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9): created successfully Sep 04 15:52:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18748a7a-db08-48f6-8c95-ac524cac0f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Flow 'volume_create_manager' (98a7570f-157b-4934-b845-f9122238ae06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:52:12 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-dbb5cb04-00ba-4577-820a-c08c4859a12b tempest-VolumesCloneNegativeTest-1859855779 None] Created volume successfully. Sep 04 15:52:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ea9dc5d8-9fcd-43b9-ac94-046c20bf1169 tempest-VolumesCloneNegativeTest-1859855779 None] Acquiring lock "cinder-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:52:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ea9dc5d8-9fcd-43b9-ac94-046c20bf1169 tempest-VolumesCloneNegativeTest-1859855779 None] Lock "cinder-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:52:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ea9dc5d8-9fcd-43b9-ac94-046c20bf1169 tempest-VolumesCloneNegativeTest-1859855779 None] Acquiring lock "cinder-quobyte-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:52:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ea9dc5d8-9fcd-43b9-ac94-046c20bf1169 tempest-VolumesCloneNegativeTest-1859855779 None] Lock "cinder-quobyte-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9" acquired by "delete_volume" :: waited 0.027s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:52:13 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f763536-064f-4148-bff8-4d9739fcfd47]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:52:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ea9dc5d8-9fcd-43b9-ac94-046c20bf1169 tempest-VolumesCloneNegativeTest-1859855779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:13 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9 Sep 04 15:52:13 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:14 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ea9dc5d8-9fcd-43b9-ac94-046c20bf1169 tempest-VolumesCloneNegativeTest-1859855779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9" returned: 0 in 0.498s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ea9dc5d8-9fcd-43b9-ac94-046c20bf1169 tempest-VolumesCloneNegativeTest-1859855779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:14 devstack sudo[91492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9 Sep 04 15:52:14 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-0d80602c-9ddd-4f71-9e39-56a93766fd3c req-02e762f0-399e-4c01-ad40-03f19acee684 tempest-AttachVolumeShelveTestJSON-2130397730 None] No connector for attachment 51190b0a-9989-47b5-84dc-5f98a6272b3b; skipping storage backend terminate_connection call. {{(pid=87513) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-0d80602c-9ddd-4f71-9e39-56a93766fd3c req-02e762f0-399e-4c01-ad40-03f19acee684 tempest-AttachVolumeShelveTestJSON-2130397730 None] Deleting attachment 51190b0a-9989-47b5-84dc-5f98a6272b3b. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:52:14 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ea9dc5d8-9fcd-43b9-ac94-046c20bf1169 tempest-VolumesCloneNegativeTest-1859855779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9" returned: 0 in 0.356s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ea9dc5d8-9fcd-43b9-ac94-046c20bf1169 tempest-VolumesCloneNegativeTest-1859855779 None] Lock "cinder-quobyte-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9" released by "delete_volume" :: held 0.928s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Flow 'volume_create_manager' (b92ace4c-a233-410f-b13a-bfe391a58f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa311d6c-d5c0-49eb-963c-e88736e05099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa311d6c-d5c0-49eb-963c-e88736e05099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-504657150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375def2f-fa35-408b-baaa-c08d908c0256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c63ca6ee1feb4d6698141161568ddd55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:15Z,use_quota=True,user_id='7c546e4b691e4e97be9b2a19a5036941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426b87f6-3df9-43be-8eb5-13dfd1fa30a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426b87f6-3df9-43be-8eb5-13dfd1fa30a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e9956a-9999-40cc-931b-e44139ebdbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e9956a-9999-40cc-931b-e44139ebdbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '375def2f-fa35-408b-baaa-c08d908c0256', 'volume_name': 'volume-375def2f-fa35-408b-baaa-c08d908c0256', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dbac117-9b1b-456b-b03f-918cf2696619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dbac117-9b1b-456b-b03f-918cf2696619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b06c77f-d56b-4a73-87d4-9a15f659f735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:14 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Volume 375def2f-fa35-408b-baaa-c08d908c0256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-375def2f-fa35-408b-baaa-c08d908c0256', 'volume_size': 1} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-504657150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375def2f-fa35-408b-baaa-c08d908c0256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c63ca6ee1feb4d6698141161568ddd55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:15Z,use_quota=True,user_id='7c546e4b691e4e97be9b2a19a5036941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Creating volume 375def2f-fa35-408b-baaa-c08d908c0256 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:52:14 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375def2f-fa35-408b-baaa-c08d908c0256 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:14 devstack sudo[91497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375def2f-fa35-408b-baaa-c08d908c0256 1073741824 Sep 04 15:52:14 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:14 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-ea9dc5d8-9fcd-43b9-ac94-046c20bf1169 tempest-VolumesCloneNegativeTest-1859855779 None] Created reservations ['b6e155cb-1583-4196-82df-3b19b92af930', '7706f71a-bd0f-43f2-a681-20e2b0a7e9dc', 'f7f0defb-12ee-4679-a98a-bbf3c40624ac', '48d5ba27-ad62-4a7d-b54d-17b43ddb4ee0'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:52:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ea9dc5d8-9fcd-43b9-ac94-046c20bf1169 tempest-VolumesCloneNegativeTest-1859855779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ea9dc5d8-9fcd-43b9-ac94-046c20bf1169 tempest-VolumesCloneNegativeTest-1859855779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ea9dc5d8-9fcd-43b9-ac94-046c20bf1169 tempest-VolumesCloneNegativeTest-1859855779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:52:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ea9dc5d8-9fcd-43b9-ac94-046c20bf1169 tempest-VolumesCloneNegativeTest-1859855779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:52:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ea9dc5d8-9fcd-43b9-ac94-046c20bf1169 tempest-VolumesCloneNegativeTest-1859855779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ea9dc5d8-9fcd-43b9-ac94-046c20bf1169 tempest-VolumesCloneNegativeTest-1859855779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:15 devstack sudo[91499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:52:15 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:15 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ea9dc5d8-9fcd-43b9-ac94-046c20bf1169 tempest-VolumesCloneNegativeTest-1859855779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.337s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:15 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-ea9dc5d8-9fcd-43b9-ac94-046c20bf1169 tempest-VolumesCloneNegativeTest-1859855779 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:52:15 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ea9dc5d8-9fcd-43b9-ac94-046c20bf1169 tempest-VolumesCloneNegativeTest-1859855779 None] Deleted volume successfully. Sep 04 15:52:15 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ea9dc5d8-9fcd-43b9-ac94-046c20bf1169 tempest-VolumesCloneNegativeTest-1859855779 None] Lock "cinder-d0dbaa7a-fa28-4b1b-bdcc-d760b32dbae9-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:52:15 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375def2f-fa35-408b-baaa-c08d908c0256 1073741824" returned: 0 in 0.658s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375def2f-fa35-408b-baaa-c08d908c0256 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:15 devstack sudo[91507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375def2f-fa35-408b-baaa-c08d908c0256 Sep 04 15:52:15 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:16 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375def2f-fa35-408b-baaa-c08d908c0256" returned: 0 in 0.426s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:52:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:16 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b06c77f-d56b-4a73-87d4-9a15f659f735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-375def2f-fa35-408b-baaa-c08d908c0256', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:16 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d26357-24c2-4b4e-a2a1-9615cbe63a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:16 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Volume volume-375def2f-fa35-408b-baaa-c08d908c0256 (375def2f-fa35-408b-baaa-c08d908c0256): created successfully Sep 04 15:52:16 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d26357-24c2-4b4e-a2a1-9615cbe63a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:16 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Flow 'volume_create_manager' (b92ace4c-a233-410f-b13a-bfe391a58f81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:52:16 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-28bc04e7-8b59-4f34-b184-06486ef9301e tempest-VolumesServicesTestJSON-1059336438 None] Created volume successfully. Sep 04 15:52:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ea73ff56-433b-4cb4-88f0-7ade4320782b tempest-VolumesServicesTestJSON-1059336438 None] Acquiring lock "cinder-375def2f-fa35-408b-baaa-c08d908c0256-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:52:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ea73ff56-433b-4cb4-88f0-7ade4320782b tempest-VolumesServicesTestJSON-1059336438 None] Lock "cinder-375def2f-fa35-408b-baaa-c08d908c0256-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:52:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ea73ff56-433b-4cb4-88f0-7ade4320782b tempest-VolumesServicesTestJSON-1059336438 None] Acquiring lock "cinder-quobyte-375def2f-fa35-408b-baaa-c08d908c0256" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:52:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ea73ff56-433b-4cb4-88f0-7ade4320782b tempest-VolumesServicesTestJSON-1059336438 None] Lock "cinder-quobyte-375def2f-fa35-408b-baaa-c08d908c0256" acquired by "delete_volume" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:52:17 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37115de-2603-4e88-99a8-182e35d490da]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:52:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ea73ff56-433b-4cb4-88f0-7ade4320782b tempest-VolumesServicesTestJSON-1059336438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375def2f-fa35-408b-baaa-c08d908c0256 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:17 devstack sudo[91530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375def2f-fa35-408b-baaa-c08d908c0256 Sep 04 15:52:17 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:17 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ea73ff56-433b-4cb4-88f0-7ade4320782b tempest-VolumesServicesTestJSON-1059336438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375def2f-fa35-408b-baaa-c08d908c0256" returned: 0 in 0.425s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ea73ff56-433b-4cb4-88f0-7ade4320782b tempest-VolumesServicesTestJSON-1059336438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375def2f-fa35-408b-baaa-c08d908c0256 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:17 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375def2f-fa35-408b-baaa-c08d908c0256 Sep 04 15:52:17 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:17 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ea73ff56-433b-4cb4-88f0-7ade4320782b tempest-VolumesServicesTestJSON-1059336438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-375def2f-fa35-408b-baaa-c08d908c0256" returned: 0 in 0.405s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ea73ff56-433b-4cb4-88f0-7ade4320782b tempest-VolumesServicesTestJSON-1059336438 None] Lock "cinder-quobyte-375def2f-fa35-408b-baaa-c08d908c0256" released by "delete_volume" :: held 0.888s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:52:18 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-ea73ff56-433b-4cb4-88f0-7ade4320782b tempest-VolumesServicesTestJSON-1059336438 None] Created reservations ['ce68ae5c-49c6-4000-b0b1-b7e001f602fc', '997d4e5a-f746-4b31-9b45-debd2c03e34f', '40201293-9f43-41e8-9dfe-85f1f9f9b4f3', '8e1584ca-ed23-4349-8b14-f0d242867b62'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:52:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ea73ff56-433b-4cb4-88f0-7ade4320782b tempest-VolumesServicesTestJSON-1059336438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ea73ff56-433b-4cb4-88f0-7ade4320782b tempest-VolumesServicesTestJSON-1059336438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:18 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ea73ff56-433b-4cb4-88f0-7ade4320782b tempest-VolumesServicesTestJSON-1059336438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:52:18 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ea73ff56-433b-4cb4-88f0-7ade4320782b tempest-VolumesServicesTestJSON-1059336438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:52:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ea73ff56-433b-4cb4-88f0-7ade4320782b tempest-VolumesServicesTestJSON-1059336438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ea73ff56-433b-4cb4-88f0-7ade4320782b tempest-VolumesServicesTestJSON-1059336438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:18 devstack sudo[91541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:52:18 devstack sudo[91541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:18 devstack sudo[91541]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ea73ff56-433b-4cb4-88f0-7ade4320782b tempest-VolumesServicesTestJSON-1059336438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.293s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:18 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-ea73ff56-433b-4cb4-88f0-7ade4320782b tempest-VolumesServicesTestJSON-1059336438 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:52:18 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ea73ff56-433b-4cb4-88f0-7ade4320782b tempest-VolumesServicesTestJSON-1059336438 None] Deleted volume successfully. Sep 04 15:52:18 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ea73ff56-433b-4cb4-88f0-7ade4320782b tempest-VolumesServicesTestJSON-1059336438 None] Lock "cinder-375def2f-fa35-408b-baaa-c08d908c0256-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Flow 'volume_create_manager' (ceb9938e-6b29-455b-930f-fe78acd9364d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc25d8d-30dc-48e8-9b94-e472ebd839d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc25d8d-30dc-48e8-9b94-e472ebd839d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1082622735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d36e81296aef4cb1aa71186d661966ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:22Z,use_quota=True,user_id='bb96b926e91b491bb590124a67d6ffcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a29c0b-561a-4e1e-842e-091fe20d0218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a29c0b-561a-4e1e-842e-091fe20d0218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c59da59-d4d2-4e14-8ed2-88e9c1fa703d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c59da59-d4d2-4e14-8ed2-88e9c1fa703d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8', 'volume_name': 'volume-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8baa287-1f01-4bfb-914d-6763c7a5aa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8baa287-1f01-4bfb-914d-6763c7a5aa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559cfd08-56bf-4c9a-8221-2999c6a55706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:21 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Volume 9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8', 'volume_size': 1} Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1082622735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d36e81296aef4cb1aa71186d661966ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:22Z,use_quota=True,user_id='bb96b926e91b491bb590124a67d6ffcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Creating volume 9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:52:21 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:52:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:21 devstack sudo[91621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8 1073741824 Sep 04 15:52:21 devstack sudo[91621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:22 devstack sudo[91621]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8 1073741824" returned: 0 in 0.729s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:22 devstack sudo[91628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8 Sep 04 15:52:22 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:23 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8" returned: 0 in 0.523s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:52:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559cfd08-56bf-4c9a-8221-2999c6a55706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a31bebc-a915-447f-8525-94acab5d9191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:23 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Volume volume-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8 (9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8): created successfully Sep 04 15:52:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a31bebc-a915-447f-8525-94acab5d9191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Flow 'volume_create_manager' (ceb9938e-6b29-455b-930f-fe78acd9364d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:52:23 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b3c7611c-35a3-4386-8191-2b70b00d8da4 tempest-VolumesListTestJSON-1637949559 None] Created volume successfully. Sep 04 15:52:24 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Flow 'volume_create_manager' (e0bca048-92a3-4e6a-a28c-d517e637cd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2586cea-1b8a-48f5-a4e3-c4e01fa313fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2586cea-1b8a-48f5-a4e3-c4e01fa313fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2023470247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26a52cca-47ed-49dc-94ee-387c9340ceae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d36e81296aef4cb1aa71186d661966ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:25Z,use_quota=True,user_id='bb96b926e91b491bb590124a67d6ffcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71a683e3-58c0-4166-be21-0c3c1ca66757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71a683e3-58c0-4166-be21-0c3c1ca66757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34dec9f-6ef4-45f3-8f7f-2b6aaec72205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34dec9f-6ef4-45f3-8f7f-2b6aaec72205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26a52cca-47ed-49dc-94ee-387c9340ceae', 'volume_name': 'volume-26a52cca-47ed-49dc-94ee-387c9340ceae', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6710c06e-6346-42ec-b1d3-ba253d36c2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6710c06e-6346-42ec-b1d3-ba253d36c2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d1d439-2832-480f-82b3-cedc470c35cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:25 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Volume 26a52cca-47ed-49dc-94ee-387c9340ceae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26a52cca-47ed-49dc-94ee-387c9340ceae', 'volume_size': 1} Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2023470247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26a52cca-47ed-49dc-94ee-387c9340ceae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d36e81296aef4cb1aa71186d661966ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:25Z,use_quota=True,user_id='bb96b926e91b491bb590124a67d6ffcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Creating volume 26a52cca-47ed-49dc-94ee-387c9340ceae {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:52:25 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-26a52cca-47ed-49dc-94ee-387c9340ceae 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:25 devstack sudo[91633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-26a52cca-47ed-49dc-94ee-387c9340ceae 1073741824 Sep 04 15:52:25 devstack sudo[91633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:25 devstack sudo[91633]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-26a52cca-47ed-49dc-94ee-387c9340ceae 1073741824" returned: 0 in 0.750s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-26a52cca-47ed-49dc-94ee-387c9340ceae {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:26 devstack sudo[91650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-26a52cca-47ed-49dc-94ee-387c9340ceae Sep 04 15:52:26 devstack sudo[91650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:26 devstack sudo[91650]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-26a52cca-47ed-49dc-94ee-387c9340ceae" returned: 0 in 0.354s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:52:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d1d439-2832-480f-82b3-cedc470c35cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26a52cca-47ed-49dc-94ee-387c9340ceae', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a234d6-3a3a-4fb8-bc01-58a0661af2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:26 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Volume volume-26a52cca-47ed-49dc-94ee-387c9340ceae (26a52cca-47ed-49dc-94ee-387c9340ceae): created successfully Sep 04 15:52:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a234d6-3a3a-4fb8-bc01-58a0661af2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Flow 'volume_create_manager' (e0bca048-92a3-4e6a-a28c-d517e637cd12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:52:26 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-46db9f70-068d-4159-b993-e4e0a0a2becb tempest-VolumesListTestJSON-1637949559 None] Created volume successfully. Sep 04 15:52:27 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:52:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Flow 'volume_create_manager' (3e65a9db-bd07-455f-9b2c-b22c6fac155d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:52:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af3f77f0-c9bb-4e31-a766-e2c18a23c71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af3f77f0-c9bb-4e31-a766-e2c18a23c71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-912654114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e1806d-acbd-4ba1-a5e0-e670e9fcaad1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d36e81296aef4cb1aa71186d661966ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:28Z,use_quota=True,user_id='bb96b926e91b491bb590124a67d6ffcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcbe72b-e46a-4204-b5d6-8608cf99b53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcbe72b-e46a-4204-b5d6-8608cf99b53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94e989a-131e-48ca-bb7a-fa9961fb82cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94e989a-131e-48ca-bb7a-fa9961fb82cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41e1806d-acbd-4ba1-a5e0-e670e9fcaad1', 'volume_name': 'volume-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a746094-f19a-4756-b3c9-fa14896f288e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a746094-f19a-4756-b3c9-fa14896f288e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87ad586-da3a-457b-a755-c4262bd1d712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:27 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Volume 41e1806d-acbd-4ba1-a5e0-e670e9fcaad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1', 'volume_size': 1} Sep 04 15:52:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:27 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-912654114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e1806d-acbd-4ba1-a5e0-e670e9fcaad1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d36e81296aef4cb1aa71186d661966ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:28Z,use_quota=True,user_id='bb96b926e91b491bb590124a67d6ffcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:52:27 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Creating volume 41e1806d-acbd-4ba1-a5e0-e670e9fcaad1 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:52:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:52:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:52:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:52:28 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:52:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:28 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1 1073741824 Sep 04 15:52:28 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:28 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1 1073741824" returned: 0 in 0.811s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:28 devstack sudo[91684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1 Sep 04 15:52:28 devstack sudo[91684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:29 devstack sudo[91684]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1" returned: 0 in 0.473s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:29 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:52:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87ad586-da3a-457b-a755-c4262bd1d712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868844bb-9cbf-4c61-beee-5db13430258d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:29 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Volume volume-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1 (41e1806d-acbd-4ba1-a5e0-e670e9fcaad1): created successfully Sep 04 15:52:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868844bb-9cbf-4c61-beee-5db13430258d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Flow 'volume_create_manager' (3e65a9db-bd07-455f-9b2c-b22c6fac155d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:52:29 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-a0254ea8-2947-41b2-82c6-118aee067d75 tempest-VolumesListTestJSON-1637949559 None] Created volume successfully. Sep 04 15:52:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c7df8329-211a-443e-82a2-11dadd0519b7 tempest-VolumesListTestJSON-1637949559 None] Acquiring lock "cinder-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:52:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c7df8329-211a-443e-82a2-11dadd0519b7 tempest-VolumesListTestJSON-1637949559 None] Lock "cinder-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:52:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c7df8329-211a-443e-82a2-11dadd0519b7 tempest-VolumesListTestJSON-1637949559 None] Acquiring lock "cinder-quobyte-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:52:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c7df8329-211a-443e-82a2-11dadd0519b7 tempest-VolumesListTestJSON-1637949559 None] Lock "cinder-quobyte-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1" acquired by "delete_volume" :: waited 0.040s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:52:34 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dee468-bb3e-422b-9466-d185022b77ab]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:52:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c7df8329-211a-443e-82a2-11dadd0519b7 tempest-VolumesListTestJSON-1637949559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:52:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:52:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:52:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:34 devstack sudo[91781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1 Sep 04 15:52:34 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:34 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:52:34 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:35 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c7df8329-211a-443e-82a2-11dadd0519b7 tempest-VolumesListTestJSON-1637949559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1" returned: 0 in 0.476s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c7df8329-211a-443e-82a2-11dadd0519b7 tempest-VolumesListTestJSON-1637949559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:35 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:35 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1 Sep 04 15:52:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.409s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:35 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:52:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:52:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 28 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:52:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:52:35 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c7df8329-211a-443e-82a2-11dadd0519b7 tempest-VolumesListTestJSON-1637949559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1" returned: 0 in 0.380s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c7df8329-211a-443e-82a2-11dadd0519b7 tempest-VolumesListTestJSON-1637949559 None] Lock "cinder-quobyte-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1" released by "delete_volume" :: held 0.939s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:52:35 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-c7df8329-211a-443e-82a2-11dadd0519b7 tempest-VolumesListTestJSON-1637949559 None] Created reservations ['32f660c4-780d-4720-af7a-9d4d555a032d', '2f534f42-a994-4fdd-adf5-79f3db92bf8e', 'a54c3624-937c-40f6-9877-068f634b28b5', '3636b565-b78e-4fe2-a454-35455ea81462'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:52:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c7df8329-211a-443e-82a2-11dadd0519b7 tempest-VolumesListTestJSON-1637949559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c7df8329-211a-443e-82a2-11dadd0519b7 tempest-VolumesListTestJSON-1637949559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c7df8329-211a-443e-82a2-11dadd0519b7 tempest-VolumesListTestJSON-1637949559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:52:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c7df8329-211a-443e-82a2-11dadd0519b7 tempest-VolumesListTestJSON-1637949559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:52:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c7df8329-211a-443e-82a2-11dadd0519b7 tempest-VolumesListTestJSON-1637949559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c7df8329-211a-443e-82a2-11dadd0519b7 tempest-VolumesListTestJSON-1637949559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:35 devstack sudo[91792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:52:35 devstack sudo[91792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:36 devstack sudo[91792]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c7df8329-211a-443e-82a2-11dadd0519b7 tempest-VolumesListTestJSON-1637949559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.305s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:36 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-c7df8329-211a-443e-82a2-11dadd0519b7 tempest-VolumesListTestJSON-1637949559 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:52:36 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-c7df8329-211a-443e-82a2-11dadd0519b7 tempest-VolumesListTestJSON-1637949559 None] Deleted volume successfully. Sep 04 15:52:36 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c7df8329-211a-443e-82a2-11dadd0519b7 tempest-VolumesListTestJSON-1637949559 None] Lock "cinder-41e1806d-acbd-4ba1-a5e0-e670e9fcaad1-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:52:36 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-697fb921-5236-4905-aea3-411716b73384 tempest-VolumesListTestJSON-1637949559 None] Acquiring lock "cinder-26a52cca-47ed-49dc-94ee-387c9340ceae-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:52:36 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-697fb921-5236-4905-aea3-411716b73384 tempest-VolumesListTestJSON-1637949559 None] Lock "cinder-26a52cca-47ed-49dc-94ee-387c9340ceae-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:52:37 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-697fb921-5236-4905-aea3-411716b73384 tempest-VolumesListTestJSON-1637949559 None] Acquiring lock "cinder-quobyte-26a52cca-47ed-49dc-94ee-387c9340ceae" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:52:37 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-697fb921-5236-4905-aea3-411716b73384 tempest-VolumesListTestJSON-1637949559 None] Lock "cinder-quobyte-26a52cca-47ed-49dc-94ee-387c9340ceae" acquired by "delete_volume" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:52:37 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7581a0b-ecdd-4499-a476-71972bf6b40a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:52:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-697fb921-5236-4905-aea3-411716b73384 tempest-VolumesListTestJSON-1637949559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-26a52cca-47ed-49dc-94ee-387c9340ceae {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:37 devstack sudo[91795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-26a52cca-47ed-49dc-94ee-387c9340ceae Sep 04 15:52:37 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:37 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-697fb921-5236-4905-aea3-411716b73384 tempest-VolumesListTestJSON-1637949559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-26a52cca-47ed-49dc-94ee-387c9340ceae" returned: 0 in 0.386s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-697fb921-5236-4905-aea3-411716b73384 tempest-VolumesListTestJSON-1637949559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-26a52cca-47ed-49dc-94ee-387c9340ceae {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:37 devstack sudo[91800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-26a52cca-47ed-49dc-94ee-387c9340ceae Sep 04 15:52:37 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:37 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-697fb921-5236-4905-aea3-411716b73384 tempest-VolumesListTestJSON-1637949559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-26a52cca-47ed-49dc-94ee-387c9340ceae" returned: 0 in 0.286s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:37 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-697fb921-5236-4905-aea3-411716b73384 tempest-VolumesListTestJSON-1637949559 None] Lock "cinder-quobyte-26a52cca-47ed-49dc-94ee-387c9340ceae" released by "delete_volume" :: held 0.726s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:52:37 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-697fb921-5236-4905-aea3-411716b73384 tempest-VolumesListTestJSON-1637949559 None] Created reservations ['e3677143-388e-472f-9b4e-2f68d5c4c98d', 'c39854c2-df02-45c6-9b79-8b3832a27ff4', '9c650f39-ad67-4460-b4e9-d33f4d60de29', '61e37fd4-cf6f-48b0-b032-49b4e24fda43'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:52:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-697fb921-5236-4905-aea3-411716b73384 tempest-VolumesListTestJSON-1637949559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-697fb921-5236-4905-aea3-411716b73384 tempest-VolumesListTestJSON-1637949559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-697fb921-5236-4905-aea3-411716b73384 tempest-VolumesListTestJSON-1637949559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:52:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-697fb921-5236-4905-aea3-411716b73384 tempest-VolumesListTestJSON-1637949559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:52:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-697fb921-5236-4905-aea3-411716b73384 tempest-VolumesListTestJSON-1637949559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-697fb921-5236-4905-aea3-411716b73384 tempest-VolumesListTestJSON-1637949559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:37 devstack sudo[91803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:52:37 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:38 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-697fb921-5236-4905-aea3-411716b73384 tempest-VolumesListTestJSON-1637949559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.338s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:38 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-697fb921-5236-4905-aea3-411716b73384 tempest-VolumesListTestJSON-1637949559 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:52:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-77a0ec2b-a1f1-484a-a7de-b9f52a9141cf tempest-VolumesListTestJSON-1637949559 None] Acquiring lock "cinder-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:52:38 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-697fb921-5236-4905-aea3-411716b73384 tempest-VolumesListTestJSON-1637949559 None] Deleted volume successfully. Sep 04 15:52:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-77a0ec2b-a1f1-484a-a7de-b9f52a9141cf tempest-VolumesListTestJSON-1637949559 None] Lock "cinder-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:52:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-697fb921-5236-4905-aea3-411716b73384 tempest-VolumesListTestJSON-1637949559 None] Lock "cinder-26a52cca-47ed-49dc-94ee-387c9340ceae-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:52:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-77a0ec2b-a1f1-484a-a7de-b9f52a9141cf tempest-VolumesListTestJSON-1637949559 None] Acquiring lock "cinder-quobyte-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:52:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-77a0ec2b-a1f1-484a-a7de-b9f52a9141cf tempest-VolumesListTestJSON-1637949559 None] Lock "cinder-quobyte-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8" acquired by "delete_volume" :: waited 0.025s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:52:38 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c827f140-ab10-44bc-8bd7-8c5c29287bab]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:52:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-77a0ec2b-a1f1-484a-a7de-b9f52a9141cf tempest-VolumesListTestJSON-1637949559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:38 devstack sudo[91806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8 Sep 04 15:52:38 devstack sudo[91806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:38 devstack sudo[91806]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-77a0ec2b-a1f1-484a-a7de-b9f52a9141cf tempest-VolumesListTestJSON-1637949559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8" returned: 0 in 0.459s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-77a0ec2b-a1f1-484a-a7de-b9f52a9141cf tempest-VolumesListTestJSON-1637949559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:38 devstack sudo[91811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8 Sep 04 15:52:38 devstack sudo[91811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:39 devstack sudo[91811]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-77a0ec2b-a1f1-484a-a7de-b9f52a9141cf tempest-VolumesListTestJSON-1637949559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8" returned: 0 in 0.286s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-77a0ec2b-a1f1-484a-a7de-b9f52a9141cf tempest-VolumesListTestJSON-1637949559 None] Lock "cinder-quobyte-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8" released by "delete_volume" :: held 0.816s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:52:39 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-77a0ec2b-a1f1-484a-a7de-b9f52a9141cf tempest-VolumesListTestJSON-1637949559 None] Created reservations ['988d7804-c629-4979-8991-5e84579b91ba', '9a5a8318-5897-45ee-b86d-5c5bbb5ed3eb', '58025537-9bfb-4c17-aea4-a46ea8c0e0d8', '61697684-f356-4bea-a3ad-72b6fb04356b'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:52:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-77a0ec2b-a1f1-484a-a7de-b9f52a9141cf tempest-VolumesListTestJSON-1637949559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-77a0ec2b-a1f1-484a-a7de-b9f52a9141cf tempest-VolumesListTestJSON-1637949559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-77a0ec2b-a1f1-484a-a7de-b9f52a9141cf tempest-VolumesListTestJSON-1637949559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:52:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-77a0ec2b-a1f1-484a-a7de-b9f52a9141cf tempest-VolumesListTestJSON-1637949559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:52:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-77a0ec2b-a1f1-484a-a7de-b9f52a9141cf tempest-VolumesListTestJSON-1637949559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-77a0ec2b-a1f1-484a-a7de-b9f52a9141cf tempest-VolumesListTestJSON-1637949559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:39 devstack sudo[91814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:52:39 devstack sudo[91814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:39 devstack sudo[91814]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-77a0ec2b-a1f1-484a-a7de-b9f52a9141cf tempest-VolumesListTestJSON-1637949559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.392s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:39 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-77a0ec2b-a1f1-484a-a7de-b9f52a9141cf tempest-VolumesListTestJSON-1637949559 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:52:39 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-77a0ec2b-a1f1-484a-a7de-b9f52a9141cf tempest-VolumesListTestJSON-1637949559 None] Deleted volume successfully. Sep 04 15:52:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-77a0ec2b-a1f1-484a-a7de-b9f52a9141cf tempest-VolumesListTestJSON-1637949559 None] Lock "cinder-9f01fa6a-c8b8-48d3-ae7e-bf2866c952b8-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Flow 'volume_create_manager' (9f5cf856-50cd-4ea3-a730-22a4f016e93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e28f316-0532-46ab-b2a7-9b9a7eeab51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e28f316-0532-46ab-b2a7-9b9a7eeab51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1912419087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa796ff9-0d54-4903-bcd8-085bfc56961e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41728d06bb99480db0b96e3d2c2f066f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:47Z,use_quota=True,user_id='e435bdf46696415ab0b940ee4ff0d282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab4175b-7a73-43af-b016-6c5a1fc836b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab4175b-7a73-43af-b016-6c5a1fc836b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efdb8afe-54b7-4fe4-9a45-8434e8baa4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efdb8afe-54b7-4fe4-9a45-8434e8baa4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa796ff9-0d54-4903-bcd8-085bfc56961e', 'volume_name': 'volume-fa796ff9-0d54-4903-bcd8-085bfc56961e', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02789904-990e-4304-b0f1-3b5998828ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02789904-990e-4304-b0f1-3b5998828ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d9b755-2369-4681-a04b-3d8b56c0fad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:46 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Volume fa796ff9-0d54-4903-bcd8-085bfc56961e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa796ff9-0d54-4903-bcd8-085bfc56961e', 'volume_size': 1} Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1912419087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa796ff9-0d54-4903-bcd8-085bfc56961e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41728d06bb99480db0b96e3d2c2f066f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:47Z,use_quota=True,user_id='e435bdf46696415ab0b940ee4ff0d282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Creating volume fa796ff9-0d54-4903-bcd8-085bfc56961e {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:52:46 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:52:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa796ff9-0d54-4903-bcd8-085bfc56961e 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:46 devstack sudo[91842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa796ff9-0d54-4903-bcd8-085bfc56961e 1073741824 Sep 04 15:52:46 devstack sudo[91842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:47 devstack sudo[91842]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa796ff9-0d54-4903-bcd8-085bfc56961e 1073741824" returned: 0 in 0.614s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa796ff9-0d54-4903-bcd8-085bfc56961e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:47 devstack sudo[91848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa796ff9-0d54-4903-bcd8-085bfc56961e Sep 04 15:52:47 devstack sudo[91848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:47 devstack sudo[91848]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa796ff9-0d54-4903-bcd8-085bfc56961e" returned: 0 in 0.265s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:52:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d9b755-2369-4681-a04b-3d8b56c0fad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa796ff9-0d54-4903-bcd8-085bfc56961e', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b134b854-94f3-494e-bb29-7eefbe1ecd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:47 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Volume volume-fa796ff9-0d54-4903-bcd8-085bfc56961e (fa796ff9-0d54-4903-bcd8-085bfc56961e): created successfully Sep 04 15:52:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b134b854-94f3-494e-bb29-7eefbe1ecd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Flow 'volume_create_manager' (9f5cf856-50cd-4ea3-a730-22a4f016e93f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:52:47 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-4d6fbda5-3fce-4e8e-9d5b-63fd1dd405c9 tempest-ServerActionsTestOtherA-1231278264 None] Created volume successfully. Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Flow 'volume_create_manager' (8b49c0cf-b7d8-45d7-b1fb-0cb1303089b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bedb3c1-8251-41e4-beed-c9225f8231a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bedb3c1-8251-41e4-beed-c9225f8231a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-123011378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3f47d2e-1adc-45db-ba90-1212ae2d42f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecbe3794496496da61c107cb5458d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:58Z,use_quota=True,user_id='65ba86a7589847938874a5df4ae635d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e887b64f-f777-4b25-bbef-ec6bc26dc9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e887b64f-f777-4b25-bbef-ec6bc26dc9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73864975-8aad-440b-b191-2ee5fdf23d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73864975-8aad-440b-b191-2ee5fdf23d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3f47d2e-1adc-45db-ba90-1212ae2d42f0', 'volume_name': 'volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7557b8dc-31c1-4f6c-923f-e4cea33a8a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7557b8dc-31c1-4f6c-923f-e4cea33a8a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554cec0f-c386-4457-8dce-c45fad901567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:57 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Volume a3f47d2e-1adc-45db-ba90-1212ae2d42f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0', 'volume_size': 1} Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-123011378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3f47d2e-1adc-45db-ba90-1212ae2d42f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecbe3794496496da61c107cb5458d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:58Z,use_quota=True,user_id='65ba86a7589847938874a5df4ae635d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Creating volume a3f47d2e-1adc-45db-ba90-1212ae2d42f0 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:52:57 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:52:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:57 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0 1073741824 Sep 04 15:52:57 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:58 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0 1073741824" returned: 0 in 0.695s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:58 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0 Sep 04 15:52:58 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:58 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0" returned: 0 in 0.413s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:52:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:58 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=90,cinder:SELECT=61,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:52:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554cec0f-c386-4457-8dce-c45fad901567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0827789-f2b4-489c-9419-61f330354f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:59 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Volume volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0 (a3f47d2e-1adc-45db-ba90-1212ae2d42f0): created successfully Sep 04 15:52:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0827789-f2b4-489c-9419-61f330354f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Flow 'volume_create_manager' (8b49c0cf-b7d8-45d7-b1fb-0cb1303089b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:52:59 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-99f7aee8-cf16-4035-87c2-aaf8949d9117 tempest-VolumesSnapshotTestJSON-1585913616 None] Created volume successfully. Sep 04 15:53:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aa5264f4-fcd8-45c6-b1e9-84633b81d837 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aa5264f4-fcd8-45c6-b1e9-84633b81d837 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:00 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-aa5264f4-fcd8-45c6-b1e9-84633b81d837 tempest-VolumesSnapshotTestJSON-1585913616 None] Creating offline snapshot ff8b53e9-6f21-498b-88be-1cde5c1b019d of volume a3f47d2e-1adc-45db-ba90-1212ae2d42f0 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:53:00 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b9ebee-174e-4423-9788-3e699e652587]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa5264f4-fcd8-45c6-b1e9-84633b81d837 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:00 devstack sudo[91904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0 Sep 04 15:53:00 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:00 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa5264f4-fcd8-45c6-b1e9-84633b81d837 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0" returned: 0 in 0.632s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa5264f4-fcd8-45c6-b1e9-84633b81d837 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.ff8b53e9-6f21-498b-88be-1cde5c1b019d 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:00 devstack sudo[91910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.ff8b53e9-6f21-498b-88be-1cde5c1b019d 1G Sep 04 15:53:00 devstack sudo[91910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:01 devstack sudo[91910]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa5264f4-fcd8-45c6-b1e9-84633b81d837 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.ff8b53e9-6f21-498b-88be-1cde5c1b019d 1G" returned: 0 in 0.787s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa5264f4-fcd8-45c6-b1e9-84633b81d837 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.ff8b53e9-6f21-498b-88be-1cde5c1b019d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:01 devstack sudo[91937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.ff8b53e9-6f21-498b-88be-1cde5c1b019d Sep 04 15:53:01 devstack sudo[91937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:02 devstack sudo[91937]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa5264f4-fcd8-45c6-b1e9-84633b81d837 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.ff8b53e9-6f21-498b-88be-1cde5c1b019d" returned: 0 in 0.522s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:02 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-aa5264f4-fcd8-45c6-b1e9-84633b81d837 tempest-VolumesSnapshotTestJSON-1585913616 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.ff8b53e9-6f21-498b-88be-1cde5c1b019d is being set with open permissions: ugo+rw Sep 04 15:53:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa5264f4-fcd8-45c6-b1e9-84633b81d837 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.ff8b53e9-6f21-498b-88be-1cde5c1b019d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:02 devstack sudo[91956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.ff8b53e9-6f21-498b-88be-1cde5c1b019d Sep 04 15:53:02 devstack sudo[91956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:02 devstack sudo[91956]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa5264f4-fcd8-45c6-b1e9-84633b81d837 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.ff8b53e9-6f21-498b-88be-1cde5c1b019d" returned: 0 in 0.351s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:02 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:DELETE=8,cinder:SELECT=66,cinder:UPDATE=97,cinder:INSERT=20 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:53:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa5264f4-fcd8-45c6-b1e9-84633b81d837 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:02 devstack sudo[91965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.info Sep 04 15:53:02 devstack sudo[91965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:02 devstack sudo[91965]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa5264f4-fcd8-45c6-b1e9-84633b81d837 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.info" returned: 0 in 0.365s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:03 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-aa5264f4-fcd8-45c6-b1e9-84633b81d837 tempest-VolumesSnapshotTestJSON-1585913616 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.info is being set with open permissions: ugo+rw Sep 04 15:53:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa5264f4-fcd8-45c6-b1e9-84633b81d837 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:03 devstack sudo[91969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.info Sep 04 15:53:03 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:03 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa5264f4-fcd8-45c6-b1e9-84633b81d837 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.info" returned: 0 in 0.333s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aa5264f4-fcd8-45c6-b1e9-84633b81d837 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.159s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:03 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-aa5264f4-fcd8-45c6-b1e9-84633b81d837 tempest-VolumesSnapshotTestJSON-1585913616 None] Create snapshot completed successfully Sep 04 15:53:04 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-ff8b53e9-6f21-498b-88be-1cde5c1b019d-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:04 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-ff8b53e9-6f21-498b-88be-1cde5c1b019d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:04 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-quobyte-a3f47d2e-1adc-45db-ba90-1212ae2d42f0" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:04 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-a3f47d2e-1adc-45db-ba90-1212ae2d42f0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:04 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-quobyte-ff8b53e9-6f21-498b-88be-1cde5c1b019d" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:04 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-ff8b53e9-6f21-498b-88be-1cde5c1b019d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] Deleting offline snapshot ff8b53e9-6f21-498b-88be-1cde5c1b019d of volume a3f47d2e-1adc-45db-ba90-1212ae2d42f0 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:53:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] snapshot_file for this snap is: volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.ff8b53e9-6f21-498b-88be-1cde5c1b019d {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:53:04 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[824aee7f-31b3-4961-b99d-428b5048c721]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.ff8b53e9-6f21-498b-88be-1cde5c1b019d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:04 devstack sudo[91977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.ff8b53e9-6f21-498b-88be-1cde5c1b019d Sep 04 15:53:04 devstack sudo[91977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:05 devstack sudo[91977]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.ff8b53e9-6f21-498b-88be-1cde5c1b019d" returned: 0 in 0.447s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:53:05 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[da911fcd-e729-4d04-92e0-22b42d2d2bdd]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:05 devstack sudo[91984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0 Sep 04 15:53:05 devstack sudo[91984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:05 devstack sudo[91984]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0" returned: 0 in 0.442s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.ff8b53e9-6f21-498b-88be-1cde5c1b019d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:05 devstack sudo[91989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.ff8b53e9-6f21-498b-88be-1cde5c1b019d Sep 04 15:53:05 devstack sudo[91989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:06 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-07453263-c3df-4217-ae46-00996cb42a93 tempest-AttachVolumeShelveTestJSON-2130397730 None] Acquiring lock "cinder-66c06fc5-e0eb-4221-ad95-5ce449664e1b-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:06 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-07453263-c3df-4217-ae46-00996cb42a93 tempest-AttachVolumeShelveTestJSON-2130397730 None] Lock "cinder-66c06fc5-e0eb-4221-ad95-5ce449664e1b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:06 devstack sudo[91989]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.ff8b53e9-6f21-498b-88be-1cde5c1b019d" returned: 0 in 0.519s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.ff8b53e9-6f21-498b-88be-1cde5c1b019d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:06 devstack sudo[91999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.ff8b53e9-6f21-498b-88be-1cde5c1b019d Sep 04 15:53:06 devstack sudo[91999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:06 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-07453263-c3df-4217-ae46-00996cb42a93 tempest-AttachVolumeShelveTestJSON-2130397730 None] Acquiring lock "cinder-quobyte-66c06fc5-e0eb-4221-ad95-5ce449664e1b" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:06 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-07453263-c3df-4217-ae46-00996cb42a93 tempest-AttachVolumeShelveTestJSON-2130397730 None] Lock "cinder-quobyte-66c06fc5-e0eb-4221-ad95-5ce449664e1b" acquired by "delete_volume" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:06 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafdbc63-e643-465e-947b-4122453938cc]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-07453263-c3df-4217-ae46-00996cb42a93 tempest-AttachVolumeShelveTestJSON-2130397730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-66c06fc5-e0eb-4221-ad95-5ce449664e1b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:06 devstack sudo[92001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-66c06fc5-e0eb-4221-ad95-5ce449664e1b Sep 04 15:53:06 devstack sudo[92001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0.ff8b53e9-6f21-498b-88be-1cde5c1b019d" returned: 0 in 0.415s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:06 devstack sudo[91999]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:06 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-ff8b53e9-6f21-498b-88be-1cde5c1b019d" released by "_delete_snapshot" :: held 2.031s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:06 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-a3f47d2e-1adc-45db-ba90-1212ae2d42f0" released by "delete_snapshot" :: held 2.061s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:06 devstack cinder-volume[87513]: WARNING cinder.quota [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:53:07 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] Created reservations ['74ce3056-ce08-40e9-8e56-5cb24a11214d', '5e3f04c2-60a2-4dbd-bc2f-d37a34511569', 'e2be0faf-7fdb-49b3-bbf8-bba1c9e2ea37', '6626fcd3-f7f1-4eed-9a3f-beba5eba43af'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:53:07 devstack sudo[92001]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-07453263-c3df-4217-ae46-00996cb42a93 tempest-AttachVolumeShelveTestJSON-2130397730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-66c06fc5-e0eb-4221-ad95-5ce449664e1b" returned: 0 in 0.678s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-07453263-c3df-4217-ae46-00996cb42a93 tempest-AttachVolumeShelveTestJSON-2130397730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-66c06fc5-e0eb-4221-ad95-5ce449664e1b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:07 devstack sudo[92026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-66c06fc5-e0eb-4221-ad95-5ce449664e1b Sep 04 15:53:07 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:07 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] Delete snapshot completed successfully. Sep 04 15:53:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-178461ca-996a-4fb2-ab38-8cce370e7366 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-ff8b53e9-6f21-498b-88be-1cde5c1b019d-delete_snapshot" released by "delete_snapshot" :: held 2.471s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:07 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-07453263-c3df-4217-ae46-00996cb42a93 tempest-AttachVolumeShelveTestJSON-2130397730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-66c06fc5-e0eb-4221-ad95-5ce449664e1b" returned: 0 in 0.442s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-07453263-c3df-4217-ae46-00996cb42a93 tempest-AttachVolumeShelveTestJSON-2130397730 None] Lock "cinder-quobyte-66c06fc5-e0eb-4221-ad95-5ce449664e1b" released by "delete_volume" :: held 1.170s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:07 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-07453263-c3df-4217-ae46-00996cb42a93 tempest-AttachVolumeShelveTestJSON-2130397730 None] Created reservations ['ef9ee292-8cbc-4a87-b8f9-e7b6368c81e0', '63adcdfc-fa80-4f33-b02f-0216ad599413', '2c5c6019-9c09-48d1-9c7a-576af915e567', 'cdac34e6-462e-4162-b738-03f3a512bbdc'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:53:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-07453263-c3df-4217-ae46-00996cb42a93 tempest-AttachVolumeShelveTestJSON-2130397730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-07453263-c3df-4217-ae46-00996cb42a93 tempest-AttachVolumeShelveTestJSON-2130397730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-07453263-c3df-4217-ae46-00996cb42a93 tempest-AttachVolumeShelveTestJSON-2130397730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:53:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-07453263-c3df-4217-ae46-00996cb42a93 tempest-AttachVolumeShelveTestJSON-2130397730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:53:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-07453263-c3df-4217-ae46-00996cb42a93 tempest-AttachVolumeShelveTestJSON-2130397730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-07453263-c3df-4217-ae46-00996cb42a93 tempest-AttachVolumeShelveTestJSON-2130397730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:07 devstack sudo[92051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:53:07 devstack sudo[92051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:08 devstack sudo[92051]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-07453263-c3df-4217-ae46-00996cb42a93 tempest-AttachVolumeShelveTestJSON-2130397730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.348s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:08 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-07453263-c3df-4217-ae46-00996cb42a93 tempest-AttachVolumeShelveTestJSON-2130397730 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:53:08 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-07453263-c3df-4217-ae46-00996cb42a93 tempest-AttachVolumeShelveTestJSON-2130397730 None] Deleted volume successfully. Sep 04 15:53:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-07453263-c3df-4217-ae46-00996cb42a93 tempest-AttachVolumeShelveTestJSON-2130397730 None] Lock "cinder-66c06fc5-e0eb-4221-ad95-5ce449664e1b-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:08 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:53:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Flow 'volume_create_manager' (dec6b2c2-4fb3-4f2d-93fc-c575523e6381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:53:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2accf0d-e108-4527-90c7-6f124195e283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2accf0d-e108-4527-90c7-6f124195e283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1271025309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79230e76-d9ec-4b8c-91d9-04143f4d6979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecbe3794496496da61c107cb5458d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:09Z,use_quota=True,user_id='65ba86a7589847938874a5df4ae635d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c4f026-591d-422c-96fa-7b6a72de70cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c4f026-591d-422c-96fa-7b6a72de70cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c42a48c-7f1d-4537-8f8f-782706c97989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c42a48c-7f1d-4537-8f8f-782706c97989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79230e76-d9ec-4b8c-91d9-04143f4d6979', 'volume_name': 'volume-79230e76-d9ec-4b8c-91d9-04143f4d6979', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913f88a6-1a2c-4a4f-8a06-da2395a30521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913f88a6-1a2c-4a4f-8a06-da2395a30521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77368bf-615b-4bce-95f9-898add7319ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:09 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Volume 79230e76-d9ec-4b8c-91d9-04143f4d6979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79230e76-d9ec-4b8c-91d9-04143f4d6979', 'volume_size': 1} Sep 04 15:53:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:09 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1271025309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79230e76-d9ec-4b8c-91d9-04143f4d6979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecbe3794496496da61c107cb5458d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:09Z,use_quota=True,user_id='65ba86a7589847938874a5df4ae635d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:53:09 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Creating volume 79230e76-d9ec-4b8c-91d9-04143f4d6979 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:53:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:09 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:53:09 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:53:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:09 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:53:09 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:53:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:09 devstack sudo[92057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 1073741824 Sep 04 15:53:09 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:10 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 1073741824" returned: 0 in 1.009s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:10 devstack sudo[92063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 Sep 04 15:53:10 devstack sudo[92063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:10 devstack sudo[92063]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979" returned: 0 in 0.313s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:53:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77368bf-615b-4bce-95f9-898add7319ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79230e76-d9ec-4b8c-91d9-04143f4d6979', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c5d191-5172-490c-bc4c-4bd7e7f5eaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:10 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Volume volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 (79230e76-d9ec-4b8c-91d9-04143f4d6979): created successfully Sep 04 15:53:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c5d191-5172-490c-bc4c-4bd7e7f5eaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Flow 'volume_create_manager' (dec6b2c2-4fb3-4f2d-93fc-c575523e6381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:53:10 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e13314d8-fe13-405f-81f8-66eecc2902b4 tempest-VolumesSnapshotTestJSON-1585913616 None] Created volume successfully. Sep 04 15:53:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b6f75581-c48e-422e-9d77-2c57167af37d tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b6f75581-c48e-422e-9d77-2c57167af37d tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-b6f75581-c48e-422e-9d77-2c57167af37d tempest-VolumesSnapshotTestJSON-1585913616 None] Creating offline snapshot d52b6789-a93c-49ac-991d-c0a44146cea9 of volume 79230e76-d9ec-4b8c-91d9-04143f4d6979 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:53:11 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[b380906b-a672-4374-b635-6a9edc5add51]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f75581-c48e-422e-9d77-2c57167af37d tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:11 devstack sudo[92066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 Sep 04 15:53:11 devstack sudo[92066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:12 devstack sudo[92066]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f75581-c48e-422e-9d77-2c57167af37d tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979" returned: 0 in 0.672s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f75581-c48e-422e-9d77-2c57167af37d tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:12 devstack sudo[92072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9 1G Sep 04 15:53:12 devstack sudo[92072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:12 devstack sudo[92072]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f75581-c48e-422e-9d77-2c57167af37d tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9 1G" returned: 0 in 0.570s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f75581-c48e-422e-9d77-2c57167af37d tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:12 devstack sudo[92078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9 Sep 04 15:53:12 devstack sudo[92078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:13 devstack sudo[92078]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f75581-c48e-422e-9d77-2c57167af37d tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9" returned: 0 in 0.355s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:13 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-b6f75581-c48e-422e-9d77-2c57167af37d tempest-VolumesSnapshotTestJSON-1585913616 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9 is being set with open permissions: ugo+rw Sep 04 15:53:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f75581-c48e-422e-9d77-2c57167af37d tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:13 devstack sudo[92083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9 Sep 04 15:53:13 devstack sudo[92083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:13 devstack sudo[92083]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f75581-c48e-422e-9d77-2c57167af37d tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9" returned: 0 in 0.539s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f75581-c48e-422e-9d77-2c57167af37d tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:13 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.info Sep 04 15:53:13 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:13 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f75581-c48e-422e-9d77-2c57167af37d tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.info" returned: 0 in 0.319s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:13 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-b6f75581-c48e-422e-9d77-2c57167af37d tempest-VolumesSnapshotTestJSON-1585913616 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.info is being set with open permissions: ugo+rw Sep 04 15:53:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f75581-c48e-422e-9d77-2c57167af37d tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:14 devstack sudo[92090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.info Sep 04 15:53:14 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:14 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f75581-c48e-422e-9d77-2c57167af37d tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.info" returned: 0 in 0.285s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b6f75581-c48e-422e-9d77-2c57167af37d tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.877s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:14 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b6f75581-c48e-422e-9d77-2c57167af37d tempest-VolumesSnapshotTestJSON-1585913616 None] Create snapshot completed successfully Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Flow 'volume_create_manager' (e1e3931c-bca5-4d96-8faf-3c3a838c3a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bef5ff-9257-445e-a17d-b748008caf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bef5ff-9257-445e-a17d-b748008caf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1444403822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4057459-67d7-440c-934c-b1125330685c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecbe3794496496da61c107cb5458d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d52b6789-a93c-49ac-991d-c0a44146cea9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:15Z,use_quota=True,user_id='65ba86a7589847938874a5df4ae635d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b328343-8e25-4e65-ab0a-4d02608e6b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b328343-8e25-4e65-ab0a-4d02608e6b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e8fbee-274e-4bf3-a06e-e391d6313fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e8fbee-274e-4bf3-a06e-e391d6313fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f4057459-67d7-440c-934c-b1125330685c', 'volume_name': 'volume-f4057459-67d7-440c-934c-b1125330685c', 'volume_size': 2, 'snapshot_id': 'd52b6789-a93c-49ac-991d-c0a44146cea9'}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38dec832-1782-424a-9f07-e28231bb7654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38dec832-1782-424a-9f07-e28231bb7654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa439b7e-90fa-4f27-84f3-eece782109a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:15 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Volume f4057459-67d7-440c-934c-b1125330685c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f4057459-67d7-440c-934c-b1125330685c', 'volume_size': 2, 'snapshot_id': 'd52b6789-a93c-49ac-991d-c0a44146cea9'} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-quobyte-d52b6789-a93c-49ac-991d-c0a44146cea9-f4057459-67d7-440c-934c-b1125330685c" by "_create_volume_from_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-d52b6789-a93c-49ac-991d-c0a44146cea9-f4057459-67d7-440c-934c-b1125330685c" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Creating volume f4057459-67d7-440c-934c-b1125330685c from snapshot d52b6789-a93c-49ac-991d-c0a44146cea9 {{(pid=87513) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-quobyte-f4057459-67d7-440c-934c-b1125330685c" by "_copy_volume_from_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-f4057459-67d7-440c-934c-b1125330685c" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] snapshot: d52b6789-a93c-49ac-991d-c0a44146cea9, volume: f4057459-67d7-440c-934c-b1125330685c, {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae39ea4b-0437-4cad-b177-c4cc1b805972]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:15 devstack sudo[92093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9 Sep 04 15:53:15 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:16 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9" returned: 0 in 0.539s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79230e76-d9ec-4b8c-91d9-04143f4d6979(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:53:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] will copy from snapshot at /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 04 15:53:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Creating direct copy from snapshot {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 04 15:53:16 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[88394815-b119-44b0-b3e6-1c70f885cdc4]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:16 devstack sudo[92099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 Sep 04 15:53:16 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:16 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979" returned: 0 in 0.518s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:16 devstack cinder-volume[87513]: DEBUG cinder.utils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Path /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f4057459-67d7-440c-934c-b1125330685c not found in is_blk_device check {{(pid=87513) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 04 15:53:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f4057459-67d7-440c-934c-b1125330685c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:16 devstack sudo[92105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f4057459-67d7-440c-934c-b1125330685c Sep 04 15:53:16 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:23 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f4057459-67d7-440c-934c-b1125330685c" returned: 0 in 6.837s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:23 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[df68d54e-4248-44eb-b803-b9ee4f309801]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:23 devstack sudo[92154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 Sep 04 15:53:23 devstack sudo[92154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:24 devstack sudo[92154]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979" returned: 0 in 0.641s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:24 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Image conversion details: src /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979, size 1024.00 MB, duration 6.84 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f4057459-67d7-440c-934c-b1125330685c {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:53:24 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Converted 1024.00 MB image at 149.75 MB/s Sep 04 15:53:24 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f4057459-67d7-440c-934c-b1125330685c is being set with open permissions: ugo+rw Sep 04 15:53:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f4057459-67d7-440c-934c-b1125330685c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:24 devstack sudo[92162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f4057459-67d7-440c-934c-b1125330685c Sep 04 15:53:24 devstack sudo[92162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:24 devstack sudo[92162]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f4057459-67d7-440c-934c-b1125330685c" returned: 0 in 0.262s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:24 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-f4057459-67d7-440c-934c-b1125330685c" released by "_copy_volume_from_snapshot" :: held 8.932s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:24 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-d52b6789-a93c-49ac-991d-c0a44146cea9-f4057459-67d7-440c-934c-b1125330685c" released by "_create_volume_from_snapshot" :: held 8.985s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa439b7e-90fa-4f27-84f3-eece782109a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4057459-67d7-440c-934c-b1125330685c', 'volume_size': 2, 'snapshot_id': 'd52b6789-a93c-49ac-991d-c0a44146cea9'}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48249f53-eb91-445a-bb11-b0f3994f5cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:24 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Volume volume-f4057459-67d7-440c-934c-b1125330685c (f4057459-67d7-440c-934c-b1125330685c): created successfully Sep 04 15:53:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48249f53-eb91-445a-bb11-b0f3994f5cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Flow 'volume_create_manager' (e1e3931c-bca5-4d96-8faf-3c3a838c3a2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:53:24 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-773bbe6a-b7d4-4bea-9800-d5735bc862d7 tempest-VolumesSnapshotTestJSON-1585913616 None] Created volume successfully. Sep 04 15:53:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-82365bb4-5464-4cd8-b3a3-c1be28c1493d tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-f4057459-67d7-440c-934c-b1125330685c-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-82365bb4-5464-4cd8-b3a3-c1be28c1493d tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-f4057459-67d7-440c-934c-b1125330685c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-82365bb4-5464-4cd8-b3a3-c1be28c1493d tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-quobyte-f4057459-67d7-440c-934c-b1125330685c" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-82365bb4-5464-4cd8-b3a3-c1be28c1493d tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-f4057459-67d7-440c-934c-b1125330685c" acquired by "delete_volume" :: waited 0.023s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:25 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c84417d-0cd0-48e1-9389-bfa2d3bbd39b]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-82365bb4-5464-4cd8-b3a3-c1be28c1493d tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f4057459-67d7-440c-934c-b1125330685c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:25 devstack sudo[92166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f4057459-67d7-440c-934c-b1125330685c Sep 04 15:53:25 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:25 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-82365bb4-5464-4cd8-b3a3-c1be28c1493d tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f4057459-67d7-440c-934c-b1125330685c" returned: 0 in 0.391s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-82365bb4-5464-4cd8-b3a3-c1be28c1493d tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f4057459-67d7-440c-934c-b1125330685c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:25 devstack sudo[92171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f4057459-67d7-440c-934c-b1125330685c Sep 04 15:53:25 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:25 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-82365bb4-5464-4cd8-b3a3-c1be28c1493d tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f4057459-67d7-440c-934c-b1125330685c" returned: 0 in 0.301s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-82365bb4-5464-4cd8-b3a3-c1be28c1493d tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-f4057459-67d7-440c-934c-b1125330685c" released by "delete_volume" :: held 0.757s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:26 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-82365bb4-5464-4cd8-b3a3-c1be28c1493d tempest-VolumesSnapshotTestJSON-1585913616 None] Created reservations ['a8a36197-07d6-4d80-ba39-1499e50f9350', 'd7f8086d-8fa2-4170-9d68-ad13d3cb1a61', '961eb66e-e6a3-48c1-87a8-4804ed5d7116', 'a9f64029-7024-44bf-a8ff-e18aa782e72f'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:53:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-82365bb4-5464-4cd8-b3a3-c1be28c1493d tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-82365bb4-5464-4cd8-b3a3-c1be28c1493d tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-82365bb4-5464-4cd8-b3a3-c1be28c1493d tempest-VolumesSnapshotTestJSON-1585913616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:53:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-82365bb4-5464-4cd8-b3a3-c1be28c1493d tempest-VolumesSnapshotTestJSON-1585913616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:53:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-82365bb4-5464-4cd8-b3a3-c1be28c1493d tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-82365bb4-5464-4cd8-b3a3-c1be28c1493d tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:26 devstack sudo[92174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:53:26 devstack sudo[92174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-d52b6789-a93c-49ac-991d-c0a44146cea9-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-d52b6789-a93c-49ac-991d-c0a44146cea9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-quobyte-79230e76-d9ec-4b8c-91d9-04143f4d6979" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-79230e76-d9ec-4b8c-91d9-04143f4d6979" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-quobyte-d52b6789-a93c-49ac-991d-c0a44146cea9" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-d52b6789-a93c-49ac-991d-c0a44146cea9" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] Deleting offline snapshot d52b6789-a93c-49ac-991d-c0a44146cea9 of volume 79230e76-d9ec-4b8c-91d9-04143f4d6979 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:53:26 devstack sudo[92174]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] snapshot_file for this snap is: volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:53:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-82365bb4-5464-4cd8-b3a3-c1be28c1493d tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.417s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:26 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-82365bb4-5464-4cd8-b3a3-c1be28c1493d tempest-VolumesSnapshotTestJSON-1585913616 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:53:26 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-82365bb4-5464-4cd8-b3a3-c1be28c1493d tempest-VolumesSnapshotTestJSON-1585913616 None] Deleted volume successfully. Sep 04 15:53:26 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e4f332-3210-4681-9b9e-d5d31cbe2293]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-82365bb4-5464-4cd8-b3a3-c1be28c1493d tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-f4057459-67d7-440c-934c-b1125330685c-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:26 devstack sudo[92181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9 Sep 04 15:53:26 devstack sudo[92181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:27 devstack sudo[92181]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9" returned: 0 in 0.501s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:27 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79230e76-d9ec-4b8c-91d9-04143f4d6979(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:53:27 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3e63dc-a9ad-482f-b579-3be812a596bb]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:27 devstack sudo[92199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 Sep 04 15:53:27 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:27 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979" returned: 0 in 0.496s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:27 devstack sudo[92204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9 Sep 04 15:53:27 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:27 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9" returned: 0 in 0.404s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:28 devstack sudo[92210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9 Sep 04 15:53:28 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:28 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979.d52b6789-a93c-49ac-991d-c0a44146cea9" returned: 0 in 0.275s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-d52b6789-a93c-49ac-991d-c0a44146cea9" released by "_delete_snapshot" :: held 1.807s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-79230e76-d9ec-4b8c-91d9-04143f4d6979" released by "delete_snapshot" :: held 1.857s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:28 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] Created reservations ['eda8e833-f0ed-4eb0-894a-afc3f044bdb0', 'b22dc0b1-ba73-4304-999c-40ec1c3b349c', 'd999334c-5204-4b63-a751-5a5fb80e81f6', '5fa32853-45c5-4e2d-b859-7cf8878badc3'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:53:28 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] Delete snapshot completed successfully. Sep 04 15:53:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-08336f8a-5456-46bf-8a3e-4bebb9065712 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-d52b6789-a93c-49ac-991d-c0a44146cea9-delete_snapshot" released by "delete_snapshot" :: held 2.039s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d05f5322-30d8-4aea-89a2-af9c400af3d4 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-79230e76-d9ec-4b8c-91d9-04143f4d6979-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d05f5322-30d8-4aea-89a2-af9c400af3d4 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-79230e76-d9ec-4b8c-91d9-04143f4d6979-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d05f5322-30d8-4aea-89a2-af9c400af3d4 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-quobyte-79230e76-d9ec-4b8c-91d9-04143f4d6979" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d05f5322-30d8-4aea-89a2-af9c400af3d4 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-79230e76-d9ec-4b8c-91d9-04143f4d6979" acquired by "delete_volume" :: waited 0.021s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:28 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a21ebb4-5cb9-41a5-9bce-1a5dc923a65f]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d05f5322-30d8-4aea-89a2-af9c400af3d4 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:29 devstack sudo[92215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 Sep 04 15:53:29 devstack sudo[92215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:29 devstack sudo[92215]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d05f5322-30d8-4aea-89a2-af9c400af3d4 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979" returned: 0 in 0.410s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d05f5322-30d8-4aea-89a2-af9c400af3d4 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:29 devstack sudo[92220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979 Sep 04 15:53:29 devstack sudo[92220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d05f5322-30d8-4aea-89a2-af9c400af3d4 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-79230e76-d9ec-4b8c-91d9-04143f4d6979" returned: 0 in 0.447s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:29 devstack sudo[92220]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:29 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d05f5322-30d8-4aea-89a2-af9c400af3d4 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-79230e76-d9ec-4b8c-91d9-04143f4d6979" released by "delete_volume" :: held 1.002s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:30 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-d05f5322-30d8-4aea-89a2-af9c400af3d4 tempest-VolumesSnapshotTestJSON-1585913616 None] Created reservations ['b884dd3f-a8f0-4f12-8d23-0e135a79cd4f', '46281c56-d314-4b39-a8bf-f098d372661a', '8efb4fdc-381c-4269-aa5b-dd6845ff5ded', 'da470707-af64-4544-98a3-17302b1aa765'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:53:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d05f5322-30d8-4aea-89a2-af9c400af3d4 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d05f5322-30d8-4aea-89a2-af9c400af3d4 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d05f5322-30d8-4aea-89a2-af9c400af3d4 tempest-VolumesSnapshotTestJSON-1585913616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:53:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d05f5322-30d8-4aea-89a2-af9c400af3d4 tempest-VolumesSnapshotTestJSON-1585913616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:53:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d05f5322-30d8-4aea-89a2-af9c400af3d4 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d05f5322-30d8-4aea-89a2-af9c400af3d4 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:30 devstack sudo[92269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:53:30 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:30 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d05f5322-30d8-4aea-89a2-af9c400af3d4 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.584s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:30 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-d05f5322-30d8-4aea-89a2-af9c400af3d4 tempest-VolumesSnapshotTestJSON-1585913616 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:53:30 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-d05f5322-30d8-4aea-89a2-af9c400af3d4 tempest-VolumesSnapshotTestJSON-1585913616 None] Deleted volume successfully. Sep 04 15:53:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d05f5322-30d8-4aea-89a2-af9c400af3d4 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-79230e76-d9ec-4b8c-91d9-04143f4d6979-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Flow 'volume_create_manager' (37cc2e96-d9a4-41ba-ac50-a23d6117b251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b21faa-a4e0-437d-95d7-8b668c849ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b21faa-a4e0-437d-95d7-8b668c849ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-752093653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abac14a2-9338-41ac-8cd9-7957aa47d979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecbe3794496496da61c107cb5458d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:32Z,use_quota=True,user_id='65ba86a7589847938874a5df4ae635d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9755d4dd-80e3-4ef8-b293-3b084d1d1c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9755d4dd-80e3-4ef8-b293-3b084d1d1c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (997554ea-6e5c-4c1a-8255-fce6351e0053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (997554ea-6e5c-4c1a-8255-fce6351e0053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abac14a2-9338-41ac-8cd9-7957aa47d979', 'volume_name': 'volume-abac14a2-9338-41ac-8cd9-7957aa47d979', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c16546-0761-48cc-a50a-9c07fecf16de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c16546-0761-48cc-a50a-9c07fecf16de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915c194e-564c-4431-beed-d19ddde03a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:32 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Volume abac14a2-9338-41ac-8cd9-7957aa47d979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abac14a2-9338-41ac-8cd9-7957aa47d979', 'volume_size': 1} Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-752093653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abac14a2-9338-41ac-8cd9-7957aa47d979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecbe3794496496da61c107cb5458d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:32Z,use_quota=True,user_id='65ba86a7589847938874a5df4ae635d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Creating volume abac14a2-9338-41ac-8cd9-7957aa47d979 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:53:32 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:53:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:32 devstack sudo[92298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979 1073741824 Sep 04 15:53:32 devstack sudo[92298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:33 devstack sudo[92298]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979 1073741824" returned: 0 in 0.634s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:33 devstack sudo[92310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979 Sep 04 15:53:33 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:33 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979" returned: 0 in 0.362s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:53:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915c194e-564c-4431-beed-d19ddde03a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abac14a2-9338-41ac-8cd9-7957aa47d979', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1f05b3-2cdb-43db-94ec-2c09385aadce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-315963bc-0f5b-4c90-9f62-f2ad1d3869f1 req-928e8202-e347-41a7-8d54-701aab4ba6f2 tempest-ServerActionsTestOtherA-1231278264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-315963bc-0f5b-4c90-9f62-f2ad1d3869f1 req-928e8202-e347-41a7-8d54-701aab4ba6f2 tempest-ServerActionsTestOtherA-1231278264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:33 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Volume volume-abac14a2-9338-41ac-8cd9-7957aa47d979 (abac14a2-9338-41ac-8cd9-7957aa47d979): created successfully Sep 04 15:53:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1f05b3-2cdb-43db-94ec-2c09385aadce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Flow 'volume_create_manager' (37cc2e96-d9a4-41ba-ac50-a23d6117b251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:53:33 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1235c2-3b9f-4a4f-9577-c166a142d57f]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-315963bc-0f5b-4c90-9f62-f2ad1d3869f1 req-928e8202-e347-41a7-8d54-701aab4ba6f2 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa796ff9-0d54-4903-bcd8-085bfc56961e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:33 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-94c53a32-b0bc-4f4f-86b6-cc1fdaff4925 tempest-VolumesSnapshotTestJSON-1585913616 None] Created volume successfully. Sep 04 15:53:33 devstack sudo[92322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa796ff9-0d54-4903-bcd8-085bfc56961e Sep 04 15:53:33 devstack sudo[92322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:34 devstack sudo[92322]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-315963bc-0f5b-4c90-9f62-f2ad1d3869f1 req-928e8202-e347-41a7-8d54-701aab4ba6f2 tempest-ServerActionsTestOtherA-1231278264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa796ff9-0d54-4903-bcd8-085bfc56961e" returned: 0 in 0.724s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-315963bc-0f5b-4c90-9f62-f2ad1d3869f1 req-928e8202-e347-41a7-8d54-701aab4ba6f2 tempest-ServerActionsTestOtherA-1231278264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.754s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-315963bc-0f5b-4c90-9f62-f2ad1d3869f1 req-928e8202-e347-41a7-8d54-701aab4ba6f2 tempest-ServerActionsTestOtherA-1231278264 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-fa796ff9-0d54-4903-bcd8-085bfc56961e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '782e28b7-d993-483a-ba6d-7e438546039c', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:53:34 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-315963bc-0f5b-4c90-9f62-f2ad1d3869f1 req-928e8202-e347-41a7-8d54-701aab4ba6f2 tempest-ServerActionsTestOtherA-1231278264 None] attachment_update completed successfully. Sep 04 15:53:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:53:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:53:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:53:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:34 devstack sudo[92356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:53:34 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3c407d9f-3c48-41b2-8a77-88c53d0bce3b tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3c407d9f-3c48-41b2-8a77-88c53d0bce3b tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-3c407d9f-3c48-41b2-8a77-88c53d0bce3b tempest-VolumesSnapshotTestJSON-1585913616 None] Creating offline snapshot 59d6718f-6469-4464-85d6-8ea573ab0101 of volume abac14a2-9338-41ac-8cd9-7957aa47d979 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1adc854-72b4-48ba-a329-466479a6920f]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3c407d9f-3c48-41b2-8a77-88c53d0bce3b tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:35 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.507s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 28 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:53:35 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979 Sep 04 15:53:35 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Flow 'volume_create_manager' (864687a0-a94b-459b-a5a6-d7b7bb93cfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c284a954-8179-4823-9045-72aa56759461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c284a954-8179-4823-9045-72aa56759461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-974404459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6324dd1bc40a489fbbfcff8e562e4691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:36Z,use_quota=True,user_id='d049d801ebd8450399044f26490e700e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f74c07-4232-4c33-9576-366af5ef08cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f74c07-4232-4c33-9576-366af5ef08cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3281e074-4cc4-4d16-8f84-e962fa0ce480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3281e074-4cc4-4d16-8f84-e962fa0ce480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7', 'volume_name': 'volume-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32edbd54-a8b8-40a6-b07c-8a64d6df4e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32edbd54-a8b8-40a6-b07c-8a64d6df4e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8bc3ba8-ec52-44f7-a04e-4ba6f9ead182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:35 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Volume b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7', 'volume_size': 1} Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:35 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3c407d9f-3c48-41b2-8a77-88c53d0bce3b tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979" returned: 0 in 0.648s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3c407d9f-3c48-41b2-8a77-88c53d0bce3b tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:35 devstack sudo[92718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101 1G Sep 04 15:53:35 devstack sudo[92718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:36 devstack sudo[92718]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3c407d9f-3c48-41b2-8a77-88c53d0bce3b tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101 1G" returned: 0 in 0.519s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3c407d9f-3c48-41b2-8a77-88c53d0bce3b tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abac14a2-9338-41ac-8cd9-7957aa47d979 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:36 devstack sudo[92725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abac14a2-9338-41ac-8cd9-7957aa47d979 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101 Sep 04 15:53:36 devstack sudo[92725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:36 devstack sudo[92725]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3c407d9f-3c48-41b2-8a77-88c53d0bce3b tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abac14a2-9338-41ac-8cd9-7957aa47d979 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101" returned: 0 in 0.341s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:36 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-3c407d9f-3c48-41b2-8a77-88c53d0bce3b tempest-VolumesSnapshotTestJSON-1585913616 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101 is being set with open permissions: ugo+rw Sep 04 15:53:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3c407d9f-3c48-41b2-8a77-88c53d0bce3b tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:36 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101 Sep 04 15:53:36 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:37 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3c407d9f-3c48-41b2-8a77-88c53d0bce3b tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101" returned: 0 in 0.335s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3c407d9f-3c48-41b2-8a77-88c53d0bce3b tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:37 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.info Sep 04 15:53:37 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:37 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3c407d9f-3c48-41b2-8a77-88c53d0bce3b tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.info" returned: 0 in 0.328s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:37 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-3c407d9f-3c48-41b2-8a77-88c53d0bce3b tempest-VolumesSnapshotTestJSON-1585913616 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.info is being set with open permissions: ugo+rw Sep 04 15:53:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3c407d9f-3c48-41b2-8a77-88c53d0bce3b tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:37 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.info Sep 04 15:53:37 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:37 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3c407d9f-3c48-41b2-8a77-88c53d0bce3b tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.info" returned: 0 in 0.416s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3c407d9f-3c48-41b2-8a77-88c53d0bce3b tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.772s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.067s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-974404459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6324dd1bc40a489fbbfcff8e562e4691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:36Z,use_quota=True,user_id='d049d801ebd8450399044f26490e700e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:53:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Creating volume b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:53:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:53:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:53:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:53:37 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:53:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:37 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7 1073741824 Sep 04 15:53:37 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:37 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-3c407d9f-3c48-41b2-8a77-88c53d0bce3b tempest-VolumesSnapshotTestJSON-1585913616 None] Create snapshot completed successfully Sep 04 15:53:38 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7 1073741824" returned: 0 in 0.889s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:38 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7 Sep 04 15:53:38 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:39 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7" returned: 0 in 0.322s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8bc3ba8-ec52-44f7-a04e-4ba6f9ead182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f428cb4-9f2b-4759-ae64-d918f6acde07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:39 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Volume volume-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7 (b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7): created successfully Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f428cb4-9f2b-4759-ae64-d918f6acde07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Flow 'volume_create_manager' (864687a0-a94b-459b-a5a6-d7b7bb93cfdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:53:39 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-aae28bd2-30fe-47e3-9cbe-1f8dc6eccc3b tempest-VolumesActionsTest-377483160 None] Created volume successfully. Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Flow 'volume_create_manager' (a7dde11e-5fa0-4a49-83a2-465333768a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e31bc4-4c4a-4aac-accb-a519e184aebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e31bc4-4c4a-4aac-accb-a519e184aebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1828651909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0b26e91-22cd-43a7-b944-da9ce21140f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecbe3794496496da61c107cb5458d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=59d6718f-6469-4464-85d6-8ea573ab0101,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:39Z,use_quota=True,user_id='65ba86a7589847938874a5df4ae635d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25de430-2bb1-4cb3-be93-cd26ab8bcc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25de430-2bb1-4cb3-be93-cd26ab8bcc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19d00ae-34b5-4745-abe6-67d903339a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19d00ae-34b5-4745-abe6-67d903339a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e0b26e91-22cd-43a7-b944-da9ce21140f3', 'volume_name': 'volume-e0b26e91-22cd-43a7-b944-da9ce21140f3', 'volume_size': 1, 'snapshot_id': '59d6718f-6469-4464-85d6-8ea573ab0101'}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a331e1d3-c674-4f59-b068-a4b8e824bc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a331e1d3-c674-4f59-b068-a4b8e824bc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a2c095-c930-4154-b33a-2c52523b6338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:39 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Volume e0b26e91-22cd-43a7-b944-da9ce21140f3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e0b26e91-22cd-43a7-b944-da9ce21140f3', 'volume_size': 1, 'snapshot_id': '59d6718f-6469-4464-85d6-8ea573ab0101'} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-quobyte-59d6718f-6469-4464-85d6-8ea573ab0101-e0b26e91-22cd-43a7-b944-da9ce21140f3" by "_create_volume_from_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-59d6718f-6469-4464-85d6-8ea573ab0101-e0b26e91-22cd-43a7-b944-da9ce21140f3" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Creating volume e0b26e91-22cd-43a7-b944-da9ce21140f3 from snapshot 59d6718f-6469-4464-85d6-8ea573ab0101 {{(pid=87513) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-quobyte-e0b26e91-22cd-43a7-b944-da9ce21140f3" by "_copy_volume_from_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-e0b26e91-22cd-43a7-b944-da9ce21140f3" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] snapshot: 59d6718f-6469-4464-85d6-8ea573ab0101, volume: e0b26e91-22cd-43a7-b944-da9ce21140f3, {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f44c39d-76a7-472d-af00-8bc7e06d6bbb]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:39 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-fa44a0c4-9f93-409b-98d7-189afb50a269 req-0114adc4-ea42-4ed1-b24a-79e4c6a7f8e9 tempest-ServerActionsTestOtherA-1231278264 None] Terminate volume connection completed successfully. Sep 04 15:53:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-fa44a0c4-9f93-409b-98d7-189afb50a269 req-0114adc4-ea42-4ed1-b24a-79e4c6a7f8e9 tempest-ServerActionsTestOtherA-1231278264 None] Deleting attachment 782e28b7-d993-483a-ba6d-7e438546039c. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:53:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-eb488a58-36a1-4694-addc-df9dbe422224 tempest-VolumesActionsTest-377483160 None] Acquiring lock "cinder-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7" by "attach_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:40 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101 Sep 04 15:53:40 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-eb488a58-36a1-4694-addc-df9dbe422224 tempest-VolumesActionsTest-377483160 None] Lock "cinder-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7" acquired by "attach_volume" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:40 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-eb488a58-36a1-4694-addc-df9dbe422224 tempest-VolumesActionsTest-377483160 None] Attaching volume b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7 to instance 33991eba-2011-41a8-8e3d-2eb1e86e0828 at mountpoint /dev/vdb on host None. Sep 04 15:53:40 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-eb488a58-36a1-4694-addc-df9dbe422224 tempest-VolumesActionsTest-377483160 None] Attach volume completed successfully. Sep 04 15:53:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-eb488a58-36a1-4694-addc-df9dbe422224 tempest-VolumesActionsTest-377483160 None] Lock "cinder-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7" released by "attach_volume" :: held 0.216s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:40 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101" returned: 0 in 0.742s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abac14a2-9338-41ac-8cd9-7957aa47d979(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:53:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] will copy from snapshot at /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979 {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 04 15:53:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Creating direct copy from snapshot {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 04 15:53:40 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6378c69c-3ab7-4351-a847-9489625476d3]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:40 devstack sudo[92803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979 Sep 04 15:53:40 devstack sudo[92803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:41 devstack sudo[92803]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979" returned: 0 in 0.633s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:41 devstack cinder-volume[87513]: DEBUG cinder.utils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Path /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e0b26e91-22cd-43a7-b944-da9ce21140f3 not found in is_blk_device check {{(pid=87513) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 04 15:53:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e0b26e91-22cd-43a7-b944-da9ce21140f3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:41 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e0b26e91-22cd-43a7-b944-da9ce21140f3 Sep 04 15:53:41 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-fa44a0c4-9f93-409b-98d7-189afb50a269 req-c703dec3-cc52-4551-84c7-01f75829cd6e tempest-ServerActionsTestOtherA-1231278264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:41 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b86f5f97-5830-49a4-b8d5-8a53459b098e tempest-VolumesActionsTest-1824184280 None] Terminate volume connection completed successfully. Sep 04 15:53:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b86f5f97-5830-49a4-b8d5-8a53459b098e tempest-VolumesActionsTest-1824184280 None] Acquiring lock "cinder-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7-detach_volume" by "detach_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b86f5f97-5830-49a4-b8d5-8a53459b098e tempest-VolumesActionsTest-1824184280 None] Lock "cinder-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:42 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b86f5f97-5830-49a4-b8d5-8a53459b098e tempest-VolumesActionsTest-1824184280 None] Detaching volume b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7 from instance 33991eba-2011-41a8-8e3d-2eb1e86e0828. Sep 04 15:53:42 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b86f5f97-5830-49a4-b8d5-8a53459b098e tempest-VolumesActionsTest-1824184280 None] Detach volume completed successfully. Sep 04 15:53:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b86f5f97-5830-49a4-b8d5-8a53459b098e tempest-VolumesActionsTest-1824184280 None] Lock "cinder-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7-detach_volume" released by "detach_volume" :: held 0.241s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-41add41c-9fd5-48e4-a8cd-bcc77e60d9fb tempest-VolumesActionsTest-377483160 None] Acquiring lock "cinder-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7-detach_volume" by "detach_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-41add41c-9fd5-48e4-a8cd-bcc77e60d9fb tempest-VolumesActionsTest-377483160 None] Lock "cinder-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7-detach_volume" acquired by "detach_volume" :: waited 0.080s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:43 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-41add41c-9fd5-48e4-a8cd-bcc77e60d9fb tempest-VolumesActionsTest-377483160 None] Volume detach called, but volume not attached. Sep 04 15:53:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-41add41c-9fd5-48e4-a8cd-bcc77e60d9fb tempest-VolumesActionsTest-377483160 None] Lock "cinder-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7-detach_volume" released by "detach_volume" :: held 0.133s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d3907ff4-6496-403d-825f-e0fef7e0d140 tempest-VolumesActionsTest-377483160 None] Acquiring lock "cinder-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d3907ff4-6496-403d-825f-e0fef7e0d140 tempest-VolumesActionsTest-377483160 None] Lock "cinder-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d3907ff4-6496-403d-825f-e0fef7e0d140 tempest-VolumesActionsTest-377483160 None] Acquiring lock "cinder-quobyte-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d3907ff4-6496-403d-825f-e0fef7e0d140 tempest-VolumesActionsTest-377483160 None] Lock "cinder-quobyte-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7" acquired by "delete_volume" :: waited 0.054s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:44 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bff80e-3412-4bc4-8fcc-a484ffcd1f12]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d3907ff4-6496-403d-825f-e0fef7e0d140 tempest-VolumesActionsTest-377483160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:44 devstack sudo[92858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7 Sep 04 15:53:45 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:45 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d3907ff4-6496-403d-825f-e0fef7e0d140 tempest-VolumesActionsTest-377483160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7" returned: 0 in 1.335s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d3907ff4-6496-403d-825f-e0fef7e0d140 tempest-VolumesActionsTest-377483160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:46 devstack sudo[92887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7 Sep 04 15:53:46 devstack sudo[92887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:46 devstack sudo[92887]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d3907ff4-6496-403d-825f-e0fef7e0d140 tempest-VolumesActionsTest-377483160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7" returned: 0 in 1.005s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d3907ff4-6496-403d-825f-e0fef7e0d140 tempest-VolumesActionsTest-377483160 None] Lock "cinder-quobyte-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7" released by "delete_volume" :: held 2.472s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:47 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-d3907ff4-6496-403d-825f-e0fef7e0d140 tempest-VolumesActionsTest-377483160 None] Created reservations ['27b376ca-0077-4e0e-bb3a-f1fe24896990', '82c92e52-07e5-43fd-a0b7-4b2adf6f353b', 'b15b5f52-d5c9-4448-bf19-dfc7b624af01', '6278a77b-cd54-4c1c-b285-a6b2f4828fc1'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:53:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d3907ff4-6496-403d-825f-e0fef7e0d140 tempest-VolumesActionsTest-377483160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d3907ff4-6496-403d-825f-e0fef7e0d140 tempest-VolumesActionsTest-377483160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d3907ff4-6496-403d-825f-e0fef7e0d140 tempest-VolumesActionsTest-377483160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:53:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d3907ff4-6496-403d-825f-e0fef7e0d140 tempest-VolumesActionsTest-377483160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:53:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d3907ff4-6496-403d-825f-e0fef7e0d140 tempest-VolumesActionsTest-377483160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d3907ff4-6496-403d-825f-e0fef7e0d140 tempest-VolumesActionsTest-377483160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:47 devstack sudo[92890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:53:47 devstack sudo[92890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:48 devstack sudo[92890]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d3907ff4-6496-403d-825f-e0fef7e0d140 tempest-VolumesActionsTest-377483160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.523s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:48 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-d3907ff4-6496-403d-825f-e0fef7e0d140 tempest-VolumesActionsTest-377483160 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:53:48 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-d3907ff4-6496-403d-825f-e0fef7e0d140 tempest-VolumesActionsTest-377483160 None] Deleted volume successfully. Sep 04 15:53:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d3907ff4-6496-403d-825f-e0fef7e0d140 tempest-VolumesActionsTest-377483160 None] Lock "cinder-b4a2f5c8-a3e6-4d85-8897-35b13d0a4cd7-delete_volume" released by "delete_volume" :: held 3.991s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:48 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e0b26e91-22cd-43a7-b944-da9ce21140f3" returned: 0 in 7.286s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:48 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[498d6bdc-5027-424f-9e48-5799475a5924]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:48 devstack sudo[92895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979 Sep 04 15:53:48 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:49 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979" returned: 0 in 0.890s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:49 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Image conversion details: src /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979, size 1024.00 MB, duration 7.29 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e0b26e91-22cd-43a7-b944-da9ce21140f3 {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:53:49 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Converted 1024.00 MB image at 140.53 MB/s Sep 04 15:53:49 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e0b26e91-22cd-43a7-b944-da9ce21140f3 is being set with open permissions: ugo+rw Sep 04 15:53:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e0b26e91-22cd-43a7-b944-da9ce21140f3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:49 devstack sudo[92921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e0b26e91-22cd-43a7-b944-da9ce21140f3 Sep 04 15:53:49 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:49 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e0b26e91-22cd-43a7-b944-da9ce21140f3" returned: 0 in 0.517s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-e0b26e91-22cd-43a7-b944-da9ce21140f3" released by "_copy_volume_from_snapshot" :: held 10.326s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-59d6718f-6469-4464-85d6-8ea573ab0101-e0b26e91-22cd-43a7-b944-da9ce21140f3" released by "_create_volume_from_snapshot" :: held 10.388s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.407s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-fa44a0c4-9f93-409b-98d7-189afb50a269 req-c703dec3-cc52-4551-84c7-01f75829cd6e tempest-ServerActionsTestOtherA-1231278264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.695s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:50 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[092bdca3-0479-4782-bbe5-424c2c70ffc7]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-fa44a0c4-9f93-409b-98d7-189afb50a269 req-c703dec3-cc52-4551-84c7-01f75829cd6e tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa796ff9-0d54-4903-bcd8-085bfc56961e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a2c095-c930-4154-b33a-2c52523b6338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0b26e91-22cd-43a7-b944-da9ce21140f3', 'volume_size': 1, 'snapshot_id': '59d6718f-6469-4464-85d6-8ea573ab0101'}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbfe009-0cb6-452c-aa81-2dc9858937e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:50 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Volume volume-e0b26e91-22cd-43a7-b944-da9ce21140f3 (e0b26e91-22cd-43a7-b944-da9ce21140f3): created successfully Sep 04 15:53:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbfe009-0cb6-452c-aa81-2dc9858937e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Flow 'volume_create_manager' (a7dde11e-5fa0-4a49-83a2-465333768a79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:53:50 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-be00f6ef-20c1-410c-97df-16f03a38f868 tempest-VolumesSnapshotTestJSON-1585913616 None] Created volume successfully. Sep 04 15:53:50 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa796ff9-0d54-4903-bcd8-085bfc56961e Sep 04 15:53:50 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:50 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-fa44a0c4-9f93-409b-98d7-189afb50a269 req-c703dec3-cc52-4551-84c7-01f75829cd6e tempest-ServerActionsTestOtherA-1231278264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa796ff9-0d54-4903-bcd8-085bfc56961e" returned: 0 in 0.590s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-fa44a0c4-9f93-409b-98d7-189afb50a269 req-c703dec3-cc52-4551-84c7-01f75829cd6e tempest-ServerActionsTestOtherA-1231278264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.614s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-fa44a0c4-9f93-409b-98d7-189afb50a269 req-c703dec3-cc52-4551-84c7-01f75829cd6e tempest-ServerActionsTestOtherA-1231278264 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-fa796ff9-0d54-4903-bcd8-085bfc56961e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b436dd11-82a7-4696-b241-8a560b66320b', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:53:50 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-fa44a0c4-9f93-409b-98d7-189afb50a269 req-c703dec3-cc52-4551-84c7-01f75829cd6e tempest-ServerActionsTestOtherA-1231278264 None] attachment_update completed successfully. Sep 04 15:53:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5f0faa1a-0957-4a7c-bad1-96d8c33cabb6 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-e0b26e91-22cd-43a7-b944-da9ce21140f3-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5f0faa1a-0957-4a7c-bad1-96d8c33cabb6 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-e0b26e91-22cd-43a7-b944-da9ce21140f3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5f0faa1a-0957-4a7c-bad1-96d8c33cabb6 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-quobyte-e0b26e91-22cd-43a7-b944-da9ce21140f3" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5f0faa1a-0957-4a7c-bad1-96d8c33cabb6 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-e0b26e91-22cd-43a7-b944-da9ce21140f3" acquired by "delete_volume" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:51 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddd790a-4576-45ad-bcdc-ae427639e4ea]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5f0faa1a-0957-4a7c-bad1-96d8c33cabb6 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e0b26e91-22cd-43a7-b944-da9ce21140f3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:51 devstack sudo[92933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e0b26e91-22cd-43a7-b944-da9ce21140f3 Sep 04 15:53:51 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:51 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5f0faa1a-0957-4a7c-bad1-96d8c33cabb6 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e0b26e91-22cd-43a7-b944-da9ce21140f3" returned: 0 in 0.520s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5f0faa1a-0957-4a7c-bad1-96d8c33cabb6 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e0b26e91-22cd-43a7-b944-da9ce21140f3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:51 devstack sudo[92943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e0b26e91-22cd-43a7-b944-da9ce21140f3 Sep 04 15:53:51 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:51 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5f0faa1a-0957-4a7c-bad1-96d8c33cabb6 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e0b26e91-22cd-43a7-b944-da9ce21140f3" returned: 0 in 0.338s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:51 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5f0faa1a-0957-4a7c-bad1-96d8c33cabb6 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-e0b26e91-22cd-43a7-b944-da9ce21140f3" released by "delete_volume" :: held 0.944s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-5f0faa1a-0957-4a7c-bad1-96d8c33cabb6 tempest-VolumesSnapshotTestJSON-1585913616 None] Created reservations ['aeff9fc5-d449-4e4f-8d09-a51ce120acb0', 'a8f1aaa3-f764-4fcf-8188-489f58a42ba4', 'a506c83c-ee6f-4db6-9f38-31517ec56026', 'b0489773-f40c-4ca7-b9db-4abfde7b5fa3'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5f0faa1a-0957-4a7c-bad1-96d8c33cabb6 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5f0faa1a-0957-4a7c-bad1-96d8c33cabb6 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5f0faa1a-0957-4a7c-bad1-96d8c33cabb6 tempest-VolumesSnapshotTestJSON-1585913616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5f0faa1a-0957-4a7c-bad1-96d8c33cabb6 tempest-VolumesSnapshotTestJSON-1585913616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5f0faa1a-0957-4a7c-bad1-96d8c33cabb6 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5f0faa1a-0957-4a7c-bad1-96d8c33cabb6 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:52 devstack sudo[92961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:53:52 devstack sudo[92961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Flow 'volume_create_manager' (c78ecbe4-0267-441e-919a-243409ac2e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0890bcdd-0a49-4af1-a563-a460452a70d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0890bcdd-0a49-4af1-a563-a460452a70d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-20838145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2dfd4e0-97c6-442d-845e-68c8f7aae99a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6324dd1bc40a489fbbfcff8e562e4691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:52Z,use_quota=True,user_id='d049d801ebd8450399044f26490e700e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd15e4a2-4053-4031-b9fb-61d4e0b15d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd15e4a2-4053-4031-b9fb-61d4e0b15d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028b25ee-2bf5-42f9-b21b-54ec80736181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028b25ee-2bf5-42f9-b21b-54ec80736181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2dfd4e0-97c6-442d-845e-68c8f7aae99a', 'volume_name': 'volume-e2dfd4e0-97c6-442d-845e-68c8f7aae99a', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481f222a-1e5f-477c-afcf-c631840e9ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481f222a-1e5f-477c-afcf-c631840e9ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c86cbc9-ce31-442e-ba67-29a118f8224a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:52 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Volume e2dfd4e0-97c6-442d-845e-68c8f7aae99a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2dfd4e0-97c6-442d-845e-68c8f7aae99a', 'volume_size': 1} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:52 devstack sudo[92961]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-20838145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2dfd4e0-97c6-442d-845e-68c8f7aae99a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6324dd1bc40a489fbbfcff8e562e4691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:52Z,use_quota=True,user_id='d049d801ebd8450399044f26490e700e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Creating volume e2dfd4e0-97c6-442d-845e-68c8f7aae99a {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:53:52 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e2dfd4e0-97c6-442d-845e-68c8f7aae99a 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5f0faa1a-0957-4a7c-bad1-96d8c33cabb6 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.378s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-5f0faa1a-0957-4a7c-bad1-96d8c33cabb6 tempest-VolumesSnapshotTestJSON-1585913616 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:53:52 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-5f0faa1a-0957-4a7c-bad1-96d8c33cabb6 tempest-VolumesSnapshotTestJSON-1585913616 None] Deleted volume successfully. Sep 04 15:53:52 devstack sudo[93029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e2dfd4e0-97c6-442d-845e-68c8f7aae99a 1073741824 Sep 04 15:53:52 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:52 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5f0faa1a-0957-4a7c-bad1-96d8c33cabb6 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-e0b26e91-22cd-43a7-b944-da9ce21140f3-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:53 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-59d6718f-6469-4464-85d6-8ea573ab0101-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:53 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e2dfd4e0-97c6-442d-845e-68c8f7aae99a 1073741824" returned: 0 in 0.843s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:53 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-59d6718f-6469-4464-85d6-8ea573ab0101-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:53 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-quobyte-abac14a2-9338-41ac-8cd9-7957aa47d979" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e2dfd4e0-97c6-442d-845e-68c8f7aae99a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:53 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-abac14a2-9338-41ac-8cd9-7957aa47d979" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:53 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-quobyte-59d6718f-6469-4464-85d6-8ea573ab0101" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:53 devstack sudo[93391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e2dfd4e0-97c6-442d-845e-68c8f7aae99a Sep 04 15:53:53 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:53 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-59d6718f-6469-4464-85d6-8ea573ab0101" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:53 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] Deleting offline snapshot 59d6718f-6469-4464-85d6-8ea573ab0101 of volume abac14a2-9338-41ac-8cd9-7957aa47d979 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:53:53 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] snapshot_file for this snap is: volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:53:53 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d63c799-11b4-4fb4-8f89-00fc42bf112a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:53 devstack sudo[93394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101 Sep 04 15:53:53 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:53 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e2dfd4e0-97c6-442d-845e-68c8f7aae99a" returned: 0 in 0.400s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:53 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:53:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:53 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c86cbc9-ce31-442e-ba67-29a118f8224a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2dfd4e0-97c6-442d-845e-68c8f7aae99a', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:53 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b8813d-5370-4ecb-a572-303784c47974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:53 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Volume volume-e2dfd4e0-97c6-442d-845e-68c8f7aae99a (e2dfd4e0-97c6-442d-845e-68c8f7aae99a): created successfully Sep 04 15:53:53 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b8813d-5370-4ecb-a572-303784c47974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:53 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Flow 'volume_create_manager' (c78ecbe4-0267-441e-919a-243409ac2e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:53:53 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b24dfd17-b0ef-4d70-a972-f4c9d0ff477d tempest-VolumesActionsTest-377483160 None] Created volume successfully. Sep 04 15:53:54 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101" returned: 0 in 0.532s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:54 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abac14a2-9338-41ac-8cd9-7957aa47d979(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:53:54 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de96680-3563-4a8f-ab85-2de7df5934c4]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:54 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979 Sep 04 15:53:54 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:54 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979" returned: 0 in 0.591s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4cf0e7f1-3758-4d1b-9377-1e95dbd5c3dc tempest-VolumesActionsTest-1824184280 None] Acquiring lock "cinder-e2dfd4e0-97c6-442d-845e-68c8f7aae99a-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:54 devstack sudo[93413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101 Sep 04 15:53:54 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4cf0e7f1-3758-4d1b-9377-1e95dbd5c3dc tempest-VolumesActionsTest-1824184280 None] Lock "cinder-e2dfd4e0-97c6-442d-845e-68c8f7aae99a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4cf0e7f1-3758-4d1b-9377-1e95dbd5c3dc tempest-VolumesActionsTest-1824184280 None] Acquiring lock "cinder-quobyte-e2dfd4e0-97c6-442d-845e-68c8f7aae99a" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4cf0e7f1-3758-4d1b-9377-1e95dbd5c3dc tempest-VolumesActionsTest-1824184280 None] Lock "cinder-quobyte-e2dfd4e0-97c6-442d-845e-68c8f7aae99a" acquired by "delete_volume" :: waited 0.042s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:55 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9813ee4c-a664-42de-8b9f-9552f1ec952f]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4cf0e7f1-3758-4d1b-9377-1e95dbd5c3dc tempest-VolumesActionsTest-1824184280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e2dfd4e0-97c6-442d-845e-68c8f7aae99a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:55 devstack sudo[93415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e2dfd4e0-97c6-442d-845e-68c8f7aae99a Sep 04 15:53:55 devstack sudo[93415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:55 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101" returned: 0 in 0.787s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:55 devstack sudo[93421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101 Sep 04 15:53:55 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:55 devstack sudo[93415]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4cf0e7f1-3758-4d1b-9377-1e95dbd5c3dc tempest-VolumesActionsTest-1824184280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e2dfd4e0-97c6-442d-845e-68c8f7aae99a" returned: 0 in 0.789s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4cf0e7f1-3758-4d1b-9377-1e95dbd5c3dc tempest-VolumesActionsTest-1824184280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e2dfd4e0-97c6-442d-845e-68c8f7aae99a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:55 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e2dfd4e0-97c6-442d-845e-68c8f7aae99a Sep 04 15:53:55 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:56 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979.59d6718f-6469-4464-85d6-8ea573ab0101" returned: 0 in 0.607s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-59d6718f-6469-4464-85d6-8ea573ab0101" released by "_delete_snapshot" :: held 2.710s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-abac14a2-9338-41ac-8cd9-7957aa47d979" released by "delete_snapshot" :: held 2.752s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:56 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] Created reservations ['16ea1999-371d-4d7c-b617-eaf76bcd92c6', 'b9b6503f-89c5-413d-b8e4-f0157d17a939', 'e0da470c-bf34-4690-8e6d-a0d845eddad3', 'dde0726f-c7b8-443a-9270-c4f8e8ee3ce5'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:53:56 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4cf0e7f1-3758-4d1b-9377-1e95dbd5c3dc tempest-VolumesActionsTest-1824184280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e2dfd4e0-97c6-442d-845e-68c8f7aae99a" returned: 0 in 0.505s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4cf0e7f1-3758-4d1b-9377-1e95dbd5c3dc tempest-VolumesActionsTest-1824184280 None] Lock "cinder-quobyte-e2dfd4e0-97c6-442d-845e-68c8f7aae99a" released by "delete_volume" :: held 1.402s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:56 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] Delete snapshot completed successfully. Sep 04 15:53:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9558c479-0e89-4594-9b63-e0db53854ed7 tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-59d6718f-6469-4464-85d6-8ea573ab0101-delete_snapshot" released by "delete_snapshot" :: held 3.026s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:56 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-4cf0e7f1-3758-4d1b-9377-1e95dbd5c3dc tempest-VolumesActionsTest-1824184280 None] Created reservations ['3eb8e6b8-ea67-4cbc-941b-3b052ce310ba', '1952cf2f-c3ab-438c-a521-5935cf60b46c', '740eede1-786a-442a-bf15-354ddf0303e3', '735099ad-a6f3-40d3-a271-3615962fd965'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:53:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4cf0e7f1-3758-4d1b-9377-1e95dbd5c3dc tempest-VolumesActionsTest-1824184280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4cf0e7f1-3758-4d1b-9377-1e95dbd5c3dc tempest-VolumesActionsTest-1824184280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4cf0e7f1-3758-4d1b-9377-1e95dbd5c3dc tempest-VolumesActionsTest-1824184280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:53:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4cf0e7f1-3758-4d1b-9377-1e95dbd5c3dc tempest-VolumesActionsTest-1824184280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:53:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4cf0e7f1-3758-4d1b-9377-1e95dbd5c3dc tempest-VolumesActionsTest-1824184280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4cf0e7f1-3758-4d1b-9377-1e95dbd5c3dc tempest-VolumesActionsTest-1824184280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:56 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:53:56 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ac96bc70-85b9-46df-9094-689de5b6991d tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-abac14a2-9338-41ac-8cd9-7957aa47d979-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ac96bc70-85b9-46df-9094-689de5b6991d tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-abac14a2-9338-41ac-8cd9-7957aa47d979-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ac96bc70-85b9-46df-9094-689de5b6991d tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-quobyte-abac14a2-9338-41ac-8cd9-7957aa47d979" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ac96bc70-85b9-46df-9094-689de5b6991d tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-abac14a2-9338-41ac-8cd9-7957aa47d979" acquired by "delete_volume" :: waited 0.034s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:57 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbcac44-bdd2-4a1b-a99b-491778c37005]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac96bc70-85b9-46df-9094-689de5b6991d tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:57 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4cf0e7f1-3758-4d1b-9377-1e95dbd5c3dc tempest-VolumesActionsTest-1824184280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.647s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:57 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-4cf0e7f1-3758-4d1b-9377-1e95dbd5c3dc tempest-VolumesActionsTest-1824184280 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:53:57 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-4cf0e7f1-3758-4d1b-9377-1e95dbd5c3dc tempest-VolumesActionsTest-1824184280 None] Deleted volume successfully. Sep 04 15:53:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4cf0e7f1-3758-4d1b-9377-1e95dbd5c3dc tempest-VolumesActionsTest-1824184280 None] Lock "cinder-e2dfd4e0-97c6-442d-845e-68c8f7aae99a-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:57 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979 Sep 04 15:53:57 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:58 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac96bc70-85b9-46df-9094-689de5b6991d tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979" returned: 0 in 0.855s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac96bc70-85b9-46df-9094-689de5b6991d tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:58 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979 Sep 04 15:53:58 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Flow 'volume_create_manager' (03a4774d-7339-487a-85d7-4e4d81307639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c147805-00ab-462a-98e9-f8c7e264fcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c147805-00ab-462a-98e9-f8c7e264fcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-173877803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eec24c3-82de-4b0a-b823-aafa1e7ec80a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6324dd1bc40a489fbbfcff8e562e4691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:58Z,use_quota=True,user_id='d049d801ebd8450399044f26490e700e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cad3fd7-91e8-4304-bf5c-c5535fd6eb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cad3fd7-91e8-4304-bf5c-c5535fd6eb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2688f93-20d6-4eac-9482-e67bd9df796e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2688f93-20d6-4eac-9482-e67bd9df796e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eec24c3-82de-4b0a-b823-aafa1e7ec80a', 'volume_name': 'volume-5eec24c3-82de-4b0a-b823-aafa1e7ec80a', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:58 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e86b2fc-f7b8-4556-b397-6a0afcdc7596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e86b2fc-f7b8-4556-b397-6a0afcdc7596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10e6d6a6-3c83-42ac-86a0-d6fda2aba87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:58 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Volume 5eec24c3-82de-4b0a-b823-aafa1e7ec80a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eec24c3-82de-4b0a-b823-aafa1e7ec80a', 'volume_size': 1} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-173877803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eec24c3-82de-4b0a-b823-aafa1e7ec80a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6324dd1bc40a489fbbfcff8e562e4691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:58Z,use_quota=True,user_id='d049d801ebd8450399044f26490e700e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Creating volume 5eec24c3-82de-4b0a-b823-aafa1e7ec80a {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:53:58 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5eec24c3-82de-4b0a-b823-aafa1e7ec80a 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac96bc70-85b9-46df-9094-689de5b6991d tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-abac14a2-9338-41ac-8cd9-7957aa47d979" returned: 0 in 0.574s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:58 devstack sudo[93459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5eec24c3-82de-4b0a-b823-aafa1e7ec80a 1073741824 Sep 04 15:53:58 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ac96bc70-85b9-46df-9094-689de5b6991d tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-abac14a2-9338-41ac-8cd9-7957aa47d979" released by "delete_volume" :: held 1.601s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-ac96bc70-85b9-46df-9094-689de5b6991d tempest-VolumesSnapshotTestJSON-1585913616 None] Created reservations ['2bd63bbf-73e7-4274-9604-c75084b54308', '95de0e6d-852f-4512-ab96-6cdeb738dbf1', 'e87e0631-5d88-4ca6-8fdd-7601d3ac6c9b', 'fbe70ec3-bfb5-4dd0-bd4b-9b71cb60f07b'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ac96bc70-85b9-46df-9094-689de5b6991d tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ac96bc70-85b9-46df-9094-689de5b6991d tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ac96bc70-85b9-46df-9094-689de5b6991d tempest-VolumesSnapshotTestJSON-1585913616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ac96bc70-85b9-46df-9094-689de5b6991d tempest-VolumesSnapshotTestJSON-1585913616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ac96bc70-85b9-46df-9094-689de5b6991d tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac96bc70-85b9-46df-9094-689de5b6991d tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:58 devstack sudo[93461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:53:58 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:59 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5eec24c3-82de-4b0a-b823-aafa1e7ec80a 1073741824" returned: 0 in 0.550s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:59 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=105,cinder:UPDATE=105,cinder:INSERT=28,cinder:DELETE=4 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:53:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5eec24c3-82de-4b0a-b823-aafa1e7ec80a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:59 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac96bc70-85b9-46df-9094-689de5b6991d tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.469s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:59 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-ac96bc70-85b9-46df-9094-689de5b6991d tempest-VolumesSnapshotTestJSON-1585913616 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:53:59 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ac96bc70-85b9-46df-9094-689de5b6991d tempest-VolumesSnapshotTestJSON-1585913616 None] Deleted volume successfully. Sep 04 15:53:59 devstack sudo[93468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5eec24c3-82de-4b0a-b823-aafa1e7ec80a Sep 04 15:53:59 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ac96bc70-85b9-46df-9094-689de5b6991d tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-abac14a2-9338-41ac-8cd9-7957aa47d979-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-dcfc076b-62e4-4276-b952-2f5c03e8490b tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-a3f47d2e-1adc-45db-ba90-1212ae2d42f0-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-dcfc076b-62e4-4276-b952-2f5c03e8490b tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-a3f47d2e-1adc-45db-ba90-1212ae2d42f0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-dcfc076b-62e4-4276-b952-2f5c03e8490b tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "cinder-quobyte-a3f47d2e-1adc-45db-ba90-1212ae2d42f0" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-dcfc076b-62e4-4276-b952-2f5c03e8490b tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-a3f47d2e-1adc-45db-ba90-1212ae2d42f0" acquired by "delete_volume" :: waited 0.031s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:59 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b112d50-4b62-48c8-a720-292a972c07d3]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dcfc076b-62e4-4276-b952-2f5c03e8490b tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:59 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5eec24c3-82de-4b0a-b823-aafa1e7ec80a" returned: 0 in 0.472s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:53:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10e6d6a6-3c83-42ac-86a0-d6fda2aba87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eec24c3-82de-4b0a-b823-aafa1e7ec80a', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1a1562-3a75-4d3a-9198-194f0c62d669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:59 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Volume volume-5eec24c3-82de-4b0a-b823-aafa1e7ec80a (5eec24c3-82de-4b0a-b823-aafa1e7ec80a): created successfully Sep 04 15:53:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1a1562-3a75-4d3a-9198-194f0c62d669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Flow 'volume_create_manager' (03a4774d-7339-487a-85d7-4e4d81307639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:53:59 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-3f1c9bc1-20cd-4b45-aaa1-69979360bcee tempest-VolumesActionsTest-377483160 None] Created volume successfully. Sep 04 15:54:00 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0 Sep 04 15:54:00 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:00 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dcfc076b-62e4-4276-b952-2f5c03e8490b tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0" returned: 0 in 0.662s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dcfc076b-62e4-4276-b952-2f5c03e8490b tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:00 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0 Sep 04 15:54:00 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5fe5402f-d0a0-4d7d-a6c2-5ee6396eb48c tempest-VolumesActionsTest-1824184280 None] Acquiring lock "cinder-5eec24c3-82de-4b0a-b823-aafa1e7ec80a-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5fe5402f-d0a0-4d7d-a6c2-5ee6396eb48c tempest-VolumesActionsTest-1824184280 None] Lock "cinder-5eec24c3-82de-4b0a-b823-aafa1e7ec80a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:00 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5fe5402f-d0a0-4d7d-a6c2-5ee6396eb48c tempest-VolumesActionsTest-1824184280 None] Acquiring lock "cinder-quobyte-5eec24c3-82de-4b0a-b823-aafa1e7ec80a" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dcfc076b-62e4-4276-b952-2f5c03e8490b tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a3f47d2e-1adc-45db-ba90-1212ae2d42f0" returned: 0 in 0.372s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5fe5402f-d0a0-4d7d-a6c2-5ee6396eb48c tempest-VolumesActionsTest-1824184280 None] Lock "cinder-quobyte-5eec24c3-82de-4b0a-b823-aafa1e7ec80a" acquired by "delete_volume" :: waited 0.055s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-dcfc076b-62e4-4276-b952-2f5c03e8490b tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-quobyte-a3f47d2e-1adc-45db-ba90-1212ae2d42f0" released by "delete_volume" :: held 1.207s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:00 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ebaebb-1760-4b79-9937-091716bdca6e]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5fe5402f-d0a0-4d7d-a6c2-5ee6396eb48c tempest-VolumesActionsTest-1824184280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5eec24c3-82de-4b0a-b823-aafa1e7ec80a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:01 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5eec24c3-82de-4b0a-b823-aafa1e7ec80a Sep 04 15:54:01 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:01 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-dcfc076b-62e4-4276-b952-2f5c03e8490b tempest-VolumesSnapshotTestJSON-1585913616 None] Created reservations ['59d8af5b-686d-4477-9a70-9595221d50bd', '56e30e1b-8baa-4da4-9135-0a702da08b92', '037c8d02-8260-4d47-9697-7883c6722be2', 'bae4a61a-29a8-40ec-8636-23c2a79b43a8'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:54:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dcfc076b-62e4-4276-b952-2f5c03e8490b tempest-VolumesSnapshotTestJSON-1585913616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dcfc076b-62e4-4276-b952-2f5c03e8490b tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:01 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-dcfc076b-62e4-4276-b952-2f5c03e8490b tempest-VolumesSnapshotTestJSON-1585913616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:54:01 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-dcfc076b-62e4-4276-b952-2f5c03e8490b tempest-VolumesSnapshotTestJSON-1585913616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:54:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dcfc076b-62e4-4276-b952-2f5c03e8490b tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dcfc076b-62e4-4276-b952-2f5c03e8490b tempest-VolumesSnapshotTestJSON-1585913616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:01 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:54:01 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:01 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dcfc076b-62e4-4276-b952-2f5c03e8490b tempest-VolumesSnapshotTestJSON-1585913616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.483s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:01 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-dcfc076b-62e4-4276-b952-2f5c03e8490b tempest-VolumesSnapshotTestJSON-1585913616 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:54:01 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-dcfc076b-62e4-4276-b952-2f5c03e8490b tempest-VolumesSnapshotTestJSON-1585913616 None] Deleted volume successfully. Sep 04 15:54:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-dcfc076b-62e4-4276-b952-2f5c03e8490b tempest-VolumesSnapshotTestJSON-1585913616 None] Lock "cinder-a3f47d2e-1adc-45db-ba90-1212ae2d42f0-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:01 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5fe5402f-d0a0-4d7d-a6c2-5ee6396eb48c tempest-VolumesActionsTest-1824184280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5eec24c3-82de-4b0a-b823-aafa1e7ec80a" returned: 0 in 1.095s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5fe5402f-d0a0-4d7d-a6c2-5ee6396eb48c tempest-VolumesActionsTest-1824184280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5eec24c3-82de-4b0a-b823-aafa1e7ec80a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:02 devstack sudo[93588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5eec24c3-82de-4b0a-b823-aafa1e7ec80a Sep 04 15:54:02 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:02 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5fe5402f-d0a0-4d7d-a6c2-5ee6396eb48c tempest-VolumesActionsTest-1824184280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5eec24c3-82de-4b0a-b823-aafa1e7ec80a" returned: 0 in 0.511s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:02 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5fe5402f-d0a0-4d7d-a6c2-5ee6396eb48c tempest-VolumesActionsTest-1824184280 None] Lock "cinder-quobyte-5eec24c3-82de-4b0a-b823-aafa1e7ec80a" released by "delete_volume" :: held 1.700s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:02 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-5fe5402f-d0a0-4d7d-a6c2-5ee6396eb48c tempest-VolumesActionsTest-1824184280 None] Created reservations ['568689b0-1b46-4a85-baa3-94744d2d9fa1', 'a9c43ecd-5901-4379-aef0-1db0ef900114', '982ecea1-f566-47c9-8d82-c004bdab471f', '31460808-2a02-4e75-9def-44618b7830da'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:54:02 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=109,cinder:DELETE=13,cinder:UPDATE=111,cinder:INSERT=25 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:54:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5fe5402f-d0a0-4d7d-a6c2-5ee6396eb48c tempest-VolumesActionsTest-1824184280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5fe5402f-d0a0-4d7d-a6c2-5ee6396eb48c tempest-VolumesActionsTest-1824184280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5fe5402f-d0a0-4d7d-a6c2-5ee6396eb48c tempest-VolumesActionsTest-1824184280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:54:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5fe5402f-d0a0-4d7d-a6c2-5ee6396eb48c tempest-VolumesActionsTest-1824184280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:54:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5fe5402f-d0a0-4d7d-a6c2-5ee6396eb48c tempest-VolumesActionsTest-1824184280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5fe5402f-d0a0-4d7d-a6c2-5ee6396eb48c tempest-VolumesActionsTest-1824184280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:02 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:54:02 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:03 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5fe5402f-d0a0-4d7d-a6c2-5ee6396eb48c tempest-VolumesActionsTest-1824184280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.364s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:03 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-5fe5402f-d0a0-4d7d-a6c2-5ee6396eb48c tempest-VolumesActionsTest-1824184280 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:54:03 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-5fe5402f-d0a0-4d7d-a6c2-5ee6396eb48c tempest-VolumesActionsTest-1824184280 None] Deleted volume successfully. Sep 04 15:54:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5fe5402f-d0a0-4d7d-a6c2-5ee6396eb48c tempest-VolumesActionsTest-1824184280 None] Lock "cinder-5eec24c3-82de-4b0a-b823-aafa1e7ec80a-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Flow 'volume_create_manager' (a2785ea3-3423-4385-9732-322a6fbf62ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c62322-9efc-4119-ac47-55dc852ede05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c62322-9efc-4119-ac47-55dc852ede05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1526921563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28ec4fa-7382-4419-a3e8-810417ef2e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6324dd1bc40a489fbbfcff8e562e4691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:05Z,use_quota=True,user_id='d049d801ebd8450399044f26490e700e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb29feb4-d88e-454a-a8f3-6c4259fd3921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb29feb4-d88e-454a-a8f3-6c4259fd3921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8030dc2-6c46-4673-bf2e-0a5011085c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8030dc2-6c46-4673-bf2e-0a5011085c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a28ec4fa-7382-4419-a3e8-810417ef2e00', 'volume_name': 'volume-a28ec4fa-7382-4419-a3e8-810417ef2e00', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3016c36a-f640-4a94-972c-e147d09548c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3016c36a-f640-4a94-972c-e147d09548c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7152dd7b-b9a1-4941-ac77-703205d33973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:04 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Volume a28ec4fa-7382-4419-a3e8-810417ef2e00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a28ec4fa-7382-4419-a3e8-810417ef2e00', 'volume_size': 1} Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1526921563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28ec4fa-7382-4419-a3e8-810417ef2e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6324dd1bc40a489fbbfcff8e562e4691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:05Z,use_quota=True,user_id='d049d801ebd8450399044f26490e700e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Creating volume a28ec4fa-7382-4419-a3e8-810417ef2e00 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:54:04 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:54:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a28ec4fa-7382-4419-a3e8-810417ef2e00 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:04 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a28ec4fa-7382-4419-a3e8-810417ef2e00 1073741824 Sep 04 15:54:04 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:05 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a28ec4fa-7382-4419-a3e8-810417ef2e00 1073741824" returned: 0 in 0.779s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a28ec4fa-7382-4419-a3e8-810417ef2e00 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:05 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a28ec4fa-7382-4419-a3e8-810417ef2e00 Sep 04 15:54:05 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:05 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a28ec4fa-7382-4419-a3e8-810417ef2e00" returned: 0 in 0.402s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:54:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7152dd7b-b9a1-4941-ac77-703205d33973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a28ec4fa-7382-4419-a3e8-810417ef2e00', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad2319d0-9177-422b-9a5f-9a4a2dda3f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:06 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Volume volume-a28ec4fa-7382-4419-a3e8-810417ef2e00 (a28ec4fa-7382-4419-a3e8-810417ef2e00): created successfully Sep 04 15:54:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad2319d0-9177-422b-9a5f-9a4a2dda3f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Flow 'volume_create_manager' (a2785ea3-3423-4385-9732-322a6fbf62ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:06 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e8969858-98ca-4782-9176-4464b26877c3 tempest-VolumesActionsTest-377483160 None] Created volume successfully. Sep 04 15:54:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-17cb38f7-44e3-47aa-8d62-abd60b2661c9 tempest-VolumesActionsTest-1824184280 None] Acquiring lock "cinder-a28ec4fa-7382-4419-a3e8-810417ef2e00-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-17cb38f7-44e3-47aa-8d62-abd60b2661c9 tempest-VolumesActionsTest-1824184280 None] Lock "cinder-a28ec4fa-7382-4419-a3e8-810417ef2e00-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-17cb38f7-44e3-47aa-8d62-abd60b2661c9 tempest-VolumesActionsTest-1824184280 None] Acquiring lock "cinder-quobyte-a28ec4fa-7382-4419-a3e8-810417ef2e00" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-17cb38f7-44e3-47aa-8d62-abd60b2661c9 tempest-VolumesActionsTest-1824184280 None] Lock "cinder-quobyte-a28ec4fa-7382-4419-a3e8-810417ef2e00" acquired by "delete_volume" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:07 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9f37b3-7f48-49e0-8a49-22d91520d3a5]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-17cb38f7-44e3-47aa-8d62-abd60b2661c9 tempest-VolumesActionsTest-1824184280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a28ec4fa-7382-4419-a3e8-810417ef2e00 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:07 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a28ec4fa-7382-4419-a3e8-810417ef2e00 Sep 04 15:54:07 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:07 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-17cb38f7-44e3-47aa-8d62-abd60b2661c9 tempest-VolumesActionsTest-1824184280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a28ec4fa-7382-4419-a3e8-810417ef2e00" returned: 0 in 0.540s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-17cb38f7-44e3-47aa-8d62-abd60b2661c9 tempest-VolumesActionsTest-1824184280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a28ec4fa-7382-4419-a3e8-810417ef2e00 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:07 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a28ec4fa-7382-4419-a3e8-810417ef2e00 Sep 04 15:54:07 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:08 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-17cb38f7-44e3-47aa-8d62-abd60b2661c9 tempest-VolumesActionsTest-1824184280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a28ec4fa-7382-4419-a3e8-810417ef2e00" returned: 0 in 0.670s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-17cb38f7-44e3-47aa-8d62-abd60b2661c9 tempest-VolumesActionsTest-1824184280 None] Lock "cinder-quobyte-a28ec4fa-7382-4419-a3e8-810417ef2e00" released by "delete_volume" :: held 1.283s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:08 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-17cb38f7-44e3-47aa-8d62-abd60b2661c9 tempest-VolumesActionsTest-1824184280 None] Created reservations ['057b7cc3-206e-4025-9c85-0f7624ac4489', 'c3e1989d-f2d7-4344-a46a-f3a0eccd50ee', '3f1423ef-f4bf-4d1d-bdc5-4ccb66963f34', '9fda1046-b554-4778-bb9c-a40ebbd4feda'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:54:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-17cb38f7-44e3-47aa-8d62-abd60b2661c9 tempest-VolumesActionsTest-1824184280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-17cb38f7-44e3-47aa-8d62-abd60b2661c9 tempest-VolumesActionsTest-1824184280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-17cb38f7-44e3-47aa-8d62-abd60b2661c9 tempest-VolumesActionsTest-1824184280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:54:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-17cb38f7-44e3-47aa-8d62-abd60b2661c9 tempest-VolumesActionsTest-1824184280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:54:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-17cb38f7-44e3-47aa-8d62-abd60b2661c9 tempest-VolumesActionsTest-1824184280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-17cb38f7-44e3-47aa-8d62-abd60b2661c9 tempest-VolumesActionsTest-1824184280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:08 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:54:08 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:09 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-17cb38f7-44e3-47aa-8d62-abd60b2661c9 tempest-VolumesActionsTest-1824184280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.357s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:09 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-17cb38f7-44e3-47aa-8d62-abd60b2661c9 tempest-VolumesActionsTest-1824184280 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:54:09 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-17cb38f7-44e3-47aa-8d62-abd60b2661c9 tempest-VolumesActionsTest-1824184280 None] Deleted volume successfully. Sep 04 15:54:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-17cb38f7-44e3-47aa-8d62-abd60b2661c9 tempest-VolumesActionsTest-1824184280 None] Lock "cinder-a28ec4fa-7382-4419-a3e8-810417ef2e00-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Flow 'volume_create_manager' (eb4388c1-cadc-44ab-ab8e-5baf501613ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19aa4ea1-a620-4b97-99ab-d40338f713b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19aa4ea1-a620-4b97-99ab-d40338f713b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1118846795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c0eafc3-c6dd-4157-a447-200ab079caec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6324dd1bc40a489fbbfcff8e562e4691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:10Z,use_quota=True,user_id='d049d801ebd8450399044f26490e700e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a5d797c-3c20-4f7e-9247-7956b796498f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a5d797c-3c20-4f7e-9247-7956b796498f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1242b351-4b0c-48b6-8422-4bfa6967655e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1242b351-4b0c-48b6-8422-4bfa6967655e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c0eafc3-c6dd-4157-a447-200ab079caec', 'volume_name': 'volume-7c0eafc3-c6dd-4157-a447-200ab079caec', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62726aaf-df01-4b24-ae02-3f414c9ba1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62726aaf-df01-4b24-ae02-3f414c9ba1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f6a651-19ea-4997-82ea-72f6386e62da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:10 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Volume 7c0eafc3-c6dd-4157-a447-200ab079caec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c0eafc3-c6dd-4157-a447-200ab079caec', 'volume_size': 1} Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1118846795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c0eafc3-c6dd-4157-a447-200ab079caec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6324dd1bc40a489fbbfcff8e562e4691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:10Z,use_quota=True,user_id='d049d801ebd8450399044f26490e700e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Creating volume 7c0eafc3-c6dd-4157-a447-200ab079caec {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:54:10 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:54:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c0eafc3-c6dd-4157-a447-200ab079caec 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:10 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c0eafc3-c6dd-4157-a447-200ab079caec 1073741824 Sep 04 15:54:10 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:11 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c0eafc3-c6dd-4157-a447-200ab079caec 1073741824" returned: 0 in 0.524s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c0eafc3-c6dd-4157-a447-200ab079caec {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:11 devstack sudo[93668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c0eafc3-c6dd-4157-a447-200ab079caec Sep 04 15:54:11 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:11 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c0eafc3-c6dd-4157-a447-200ab079caec" returned: 0 in 0.293s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:54:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f6a651-19ea-4997-82ea-72f6386e62da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c0eafc3-c6dd-4157-a447-200ab079caec', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862ca438-4674-4e79-91b7-1ffa8bad0e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:11 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Volume volume-7c0eafc3-c6dd-4157-a447-200ab079caec (7c0eafc3-c6dd-4157-a447-200ab079caec): created successfully Sep 04 15:54:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862ca438-4674-4e79-91b7-1ffa8bad0e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Flow 'volume_create_manager' (eb4388c1-cadc-44ab-ab8e-5baf501613ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:11 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b81a417d-d4af-4cf0-80e9-c1c0b6a8bee9 tempest-VolumesActionsTest-377483160 None] Created volume successfully. Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Flow 'volume_create_manager' (8748d101-9053-4d87-9650-5b6f85e4ad3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30870bce-2d7a-4100-9918-fa30548c8ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-89e6d701-27eb-4893-97e0-67f874889253 tempest-VolumesActionsTest-1824184280 None] Acquiring lock "cinder-7c0eafc3-c6dd-4157-a447-200ab079caec-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30870bce-2d7a-4100-9918-fa30548c8ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1166496554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0775eb48-bedd-4345-8aab-e8584601c487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08b9ba8aa9644e1c878753c0f9e83cdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:13Z,use_quota=True,user_id='10634290e5684b088a97194f279fc71a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fa8a89-f01d-479b-af2b-9b9f2b8ce727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fa8a89-f01d-479b-af2b-9b9f2b8ce727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b4bf0a-f63b-464d-b8e3-348eec480c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b4bf0a-f63b-464d-b8e3-348eec480c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0775eb48-bedd-4345-8aab-e8584601c487', 'volume_name': 'volume-0775eb48-bedd-4345-8aab-e8584601c487', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deaffecb-ffd8-476a-a4ab-af0e6020b013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deaffecb-ffd8-476a-a4ab-af0e6020b013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd8bbd1-0a6b-4972-aa11-a6a225255d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:12 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Volume 0775eb48-bedd-4345-8aab-e8584601c487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0775eb48-bedd-4345-8aab-e8584601c487', 'volume_size': 1} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1166496554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0775eb48-bedd-4345-8aab-e8584601c487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08b9ba8aa9644e1c878753c0f9e83cdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:13Z,use_quota=True,user_id='10634290e5684b088a97194f279fc71a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Creating volume 0775eb48-bedd-4345-8aab-e8584601c487 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:54:12 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-89e6d701-27eb-4893-97e0-67f874889253 tempest-VolumesActionsTest-1824184280 None] Lock "cinder-7c0eafc3-c6dd-4157-a447-200ab079caec-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:12 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487 1073741824 Sep 04 15:54:12 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-89e6d701-27eb-4893-97e0-67f874889253 tempest-VolumesActionsTest-1824184280 None] Acquiring lock "cinder-quobyte-7c0eafc3-c6dd-4157-a447-200ab079caec" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-89e6d701-27eb-4893-97e0-67f874889253 tempest-VolumesActionsTest-1824184280 None] Lock "cinder-quobyte-7c0eafc3-c6dd-4157-a447-200ab079caec" acquired by "delete_volume" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dde92c-68b0-4fcd-b9b6-cbc0f68fbb56]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-89e6d701-27eb-4893-97e0-67f874889253 tempest-VolumesActionsTest-1824184280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c0eafc3-c6dd-4157-a447-200ab079caec {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:13 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c0eafc3-c6dd-4157-a447-200ab079caec Sep 04 15:54:13 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:13 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487 1073741824" returned: 0 in 0.507s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:13 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-89e6d701-27eb-4893-97e0-67f874889253 tempest-VolumesActionsTest-1824184280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c0eafc3-c6dd-4157-a447-200ab079caec" returned: 0 in 0.432s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-89e6d701-27eb-4893-97e0-67f874889253 tempest-VolumesActionsTest-1824184280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c0eafc3-c6dd-4157-a447-200ab079caec {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:13 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c0eafc3-c6dd-4157-a447-200ab079caec Sep 04 15:54:13 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:13 devstack sudo[93708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487 Sep 04 15:54:13 devstack sudo[93708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:13 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-89e6d701-27eb-4893-97e0-67f874889253 tempest-VolumesActionsTest-1824184280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c0eafc3-c6dd-4157-a447-200ab079caec" returned: 0 in 0.285s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:13 devstack sudo[93708]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-89e6d701-27eb-4893-97e0-67f874889253 tempest-VolumesActionsTest-1824184280 None] Lock "cinder-quobyte-7c0eafc3-c6dd-4157-a447-200ab079caec" released by "delete_volume" :: held 0.770s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487" returned: 0 in 0.283s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:54:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd8bbd1-0a6b-4972-aa11-a6a225255d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0775eb48-bedd-4345-8aab-e8584601c487', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52482fb0-a965-48eb-bd83-478adcbefeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:13 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Volume volume-0775eb48-bedd-4345-8aab-e8584601c487 (0775eb48-bedd-4345-8aab-e8584601c487): created successfully Sep 04 15:54:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52482fb0-a965-48eb-bd83-478adcbefeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Flow 'volume_create_manager' (8748d101-9053-4d87-9650-5b6f85e4ad3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:13 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-fc56a0a4-82f5-4abf-9f27-50096de0d395 tempest-VolumesSnapshotListTestJSON-2084216790 None] Created volume successfully. Sep 04 15:54:13 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-89e6d701-27eb-4893-97e0-67f874889253 tempest-VolumesActionsTest-1824184280 None] Created reservations ['03562ddf-07a1-4ff6-846b-afc7a7eae000', '8f868418-af7c-4441-9ea4-a14926e162e3', '0d230ab2-624f-4a87-bff4-3ca0583f6731', 'ce29f3ad-d433-4104-9691-20033ef10807'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:54:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-89e6d701-27eb-4893-97e0-67f874889253 tempest-VolumesActionsTest-1824184280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-89e6d701-27eb-4893-97e0-67f874889253 tempest-VolumesActionsTest-1824184280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-89e6d701-27eb-4893-97e0-67f874889253 tempest-VolumesActionsTest-1824184280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:54:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-89e6d701-27eb-4893-97e0-67f874889253 tempest-VolumesActionsTest-1824184280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:54:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-89e6d701-27eb-4893-97e0-67f874889253 tempest-VolumesActionsTest-1824184280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-89e6d701-27eb-4893-97e0-67f874889253 tempest-VolumesActionsTest-1824184280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:13 devstack sudo[93713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:54:13 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:14 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-89e6d701-27eb-4893-97e0-67f874889253 tempest-VolumesActionsTest-1824184280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.294s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-89e6d701-27eb-4893-97e0-67f874889253 tempest-VolumesActionsTest-1824184280 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:54:14 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-89e6d701-27eb-4893-97e0-67f874889253 tempest-VolumesActionsTest-1824184280 None] Deleted volume successfully. Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-89e6d701-27eb-4893-97e0-67f874889253 tempest-VolumesActionsTest-1824184280 None] Lock "cinder-7c0eafc3-c6dd-4157-a447-200ab079caec-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Flow 'volume_create_manager' (f47397fb-178f-420d-8be7-ddecc816c363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ba8613-0b46-4cc5-aff1-907c9758ac9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ba8613-0b46-4cc5-aff1-907c9758ac9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1840568165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db805747-b7e5-4aa9-afad-f0f0cffcbc94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6324dd1bc40a489fbbfcff8e562e4691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:14Z,use_quota=True,user_id='d049d801ebd8450399044f26490e700e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e4cf57-2d9b-4bdc-ae01-4ca421132e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e4cf57-2d9b-4bdc-ae01-4ca421132e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6c8399-5c77-4107-b254-01fc1c7b8e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6c8399-5c77-4107-b254-01fc1c7b8e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db805747-b7e5-4aa9-afad-f0f0cffcbc94', 'volume_name': 'volume-db805747-b7e5-4aa9-afad-f0f0cffcbc94', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f3e716-18b1-4d01-ac40-73e55386184f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f3e716-18b1-4d01-ac40-73e55386184f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992e2264-bac7-4fc3-af90-ffc45d50254f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:14 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Volume db805747-b7e5-4aa9-afad-f0f0cffcbc94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db805747-b7e5-4aa9-afad-f0f0cffcbc94', 'volume_size': 1} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1840568165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db805747-b7e5-4aa9-afad-f0f0cffcbc94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6324dd1bc40a489fbbfcff8e562e4691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:14Z,use_quota=True,user_id='d049d801ebd8450399044f26490e700e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Creating volume db805747-b7e5-4aa9-afad-f0f0cffcbc94 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:54:14 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:54:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db805747-b7e5-4aa9-afad-f0f0cffcbc94 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:14 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db805747-b7e5-4aa9-afad-f0f0cffcbc94 1073741824 Sep 04 15:54:14 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-862ac752-3eed-4df7-8d4f-7c3ae52efe4a tempest-VolumesSnapshotListTestJSON-2084216790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:15 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db805747-b7e5-4aa9-afad-f0f0cffcbc94 1073741824" returned: 0 in 0.485s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db805747-b7e5-4aa9-afad-f0f0cffcbc94 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:15 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db805747-b7e5-4aa9-afad-f0f0cffcbc94 Sep 04 15:54:15 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:15 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db805747-b7e5-4aa9-afad-f0f0cffcbc94" returned: 0 in 0.244s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:54:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-862ac752-3eed-4df7-8d4f-7c3ae52efe4a tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.346s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-862ac752-3eed-4df7-8d4f-7c3ae52efe4a tempest-VolumesSnapshotListTestJSON-2084216790 None] Creating offline snapshot b7321b46-fa2e-4c63-bb1e-c44f05fc06aa of volume 0775eb48-bedd-4345-8aab-e8584601c487 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:54:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992e2264-bac7-4fc3-af90-ffc45d50254f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db805747-b7e5-4aa9-afad-f0f0cffcbc94', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f1c8a6-6a1e-420c-951c-044d369f6b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:15 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ca25b7-c2d3-48f1-804f-985e98f6b38a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-862ac752-3eed-4df7-8d4f-7c3ae52efe4a tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:15 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Volume volume-db805747-b7e5-4aa9-afad-f0f0cffcbc94 (db805747-b7e5-4aa9-afad-f0f0cffcbc94): created successfully Sep 04 15:54:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f1c8a6-6a1e-420c-951c-044d369f6b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Flow 'volume_create_manager' (f47397fb-178f-420d-8be7-ddecc816c363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:15 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-5bf91d6e-70a8-41bb-8623-0cc29fae79b9 tempest-VolumesActionsTest-377483160 None] Created volume successfully. Sep 04 15:54:15 devstack sudo[93725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487 Sep 04 15:54:15 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:15 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-862ac752-3eed-4df7-8d4f-7c3ae52efe4a tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487" returned: 0 in 0.364s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-862ac752-3eed-4df7-8d4f-7c3ae52efe4a tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:15 devstack sudo[93730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa 1G Sep 04 15:54:15 devstack sudo[93730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:16 devstack sudo[93730]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-862ac752-3eed-4df7-8d4f-7c3ae52efe4a tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa 1G" returned: 0 in 0.395s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-862ac752-3eed-4df7-8d4f-7c3ae52efe4a tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0775eb48-bedd-4345-8aab-e8584601c487 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:16 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0775eb48-bedd-4345-8aab-e8584601c487 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa Sep 04 15:54:16 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:16 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-862ac752-3eed-4df7-8d4f-7c3ae52efe4a tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0775eb48-bedd-4345-8aab-e8584601c487 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa" returned: 0 in 0.277s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:16 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-862ac752-3eed-4df7-8d4f-7c3ae52efe4a tempest-VolumesSnapshotListTestJSON-2084216790 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa is being set with open permissions: ugo+rw Sep 04 15:54:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-862ac752-3eed-4df7-8d4f-7c3ae52efe4a tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:16 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa Sep 04 15:54:16 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:16 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-862ac752-3eed-4df7-8d4f-7c3ae52efe4a tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa" returned: 0 in 0.256s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-862ac752-3eed-4df7-8d4f-7c3ae52efe4a tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:16 devstack sudo[93743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.info Sep 04 15:54:16 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:17 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-862ac752-3eed-4df7-8d4f-7c3ae52efe4a tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.info" returned: 0 in 0.327s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:17 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-862ac752-3eed-4df7-8d4f-7c3ae52efe4a tempest-VolumesSnapshotListTestJSON-2084216790 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.info is being set with open permissions: ugo+rw Sep 04 15:54:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-862ac752-3eed-4df7-8d4f-7c3ae52efe4a tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:17 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.info Sep 04 15:54:17 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f9544127-5421-4dea-b660-424cee906158 tempest-VolumesActionsTest-377483160 None] Acquiring lock "cinder-db805747-b7e5-4aa9-afad-f0f0cffcbc94-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f9544127-5421-4dea-b660-424cee906158 tempest-VolumesActionsTest-377483160 None] Lock "cinder-db805747-b7e5-4aa9-afad-f0f0cffcbc94-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f9544127-5421-4dea-b660-424cee906158 tempest-VolumesActionsTest-377483160 None] Acquiring lock "cinder-quobyte-db805747-b7e5-4aa9-afad-f0f0cffcbc94" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:17 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f9544127-5421-4dea-b660-424cee906158 tempest-VolumesActionsTest-377483160 None] Lock "cinder-quobyte-db805747-b7e5-4aa9-afad-f0f0cffcbc94" acquired by "delete_volume" :: waited 0.022s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-862ac752-3eed-4df7-8d4f-7c3ae52efe4a tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.info" returned: 0 in 0.393s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-862ac752-3eed-4df7-8d4f-7c3ae52efe4a tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.146s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:17 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20c2315-e0f7-42f5-b97e-c71271926121]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f9544127-5421-4dea-b660-424cee906158 tempest-VolumesActionsTest-377483160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db805747-b7e5-4aa9-afad-f0f0cffcbc94 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:17 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-862ac752-3eed-4df7-8d4f-7c3ae52efe4a tempest-VolumesSnapshotListTestJSON-2084216790 None] Create snapshot completed successfully Sep 04 15:54:17 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db805747-b7e5-4aa9-afad-f0f0cffcbc94 Sep 04 15:54:17 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:17 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f9544127-5421-4dea-b660-424cee906158 tempest-VolumesActionsTest-377483160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db805747-b7e5-4aa9-afad-f0f0cffcbc94" returned: 0 in 0.392s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f9544127-5421-4dea-b660-424cee906158 tempest-VolumesActionsTest-377483160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db805747-b7e5-4aa9-afad-f0f0cffcbc94 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:17 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db805747-b7e5-4aa9-afad-f0f0cffcbc94 Sep 04 15:54:17 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:18 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f9544127-5421-4dea-b660-424cee906158 tempest-VolumesActionsTest-377483160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-db805747-b7e5-4aa9-afad-f0f0cffcbc94" returned: 0 in 0.261s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:18 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f9544127-5421-4dea-b660-424cee906158 tempest-VolumesActionsTest-377483160 None] Lock "cinder-quobyte-db805747-b7e5-4aa9-afad-f0f0cffcbc94" released by "delete_volume" :: held 0.714s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:18 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-f9544127-5421-4dea-b660-424cee906158 tempest-VolumesActionsTest-377483160 None] Created reservations ['361f9230-e20b-49b8-bc45-dc4ac658a6fe', '60ed1a0a-7359-4aff-a820-cc131748c1df', 'ee80db6b-4f9c-4160-89cc-a548613ab497', 'e4b7a2ba-21ea-4157-93a3-8ae03bf8f609'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:54:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f9544127-5421-4dea-b660-424cee906158 tempest-VolumesActionsTest-377483160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f9544127-5421-4dea-b660-424cee906158 tempest-VolumesActionsTest-377483160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:18 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f9544127-5421-4dea-b660-424cee906158 tempest-VolumesActionsTest-377483160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:54:18 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f9544127-5421-4dea-b660-424cee906158 tempest-VolumesActionsTest-377483160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:54:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f9544127-5421-4dea-b660-424cee906158 tempest-VolumesActionsTest-377483160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f9544127-5421-4dea-b660-424cee906158 tempest-VolumesActionsTest-377483160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:18 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:54:18 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-34d8c72b-9db8-41bc-b17c-cbf150f22b8b tempest-VolumesSnapshotListTestJSON-2084216790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-34d8c72b-9db8-41bc-b17c-cbf150f22b8b tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:18 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-34d8c72b-9db8-41bc-b17c-cbf150f22b8b tempest-VolumesSnapshotListTestJSON-2084216790 None] Creating offline snapshot c2e5bf98-303a-4ce7-98b7-9ddb6f96169a of volume 0775eb48-bedd-4345-8aab-e8584601c487 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:54:18 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b4f448-bfb7-4638-a820-1a3014ec5546]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34d8c72b-9db8-41bc-b17c-cbf150f22b8b tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:18 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa Sep 04 15:54:18 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:18 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f9544127-5421-4dea-b660-424cee906158 tempest-VolumesActionsTest-377483160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.308s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:18 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-f9544127-5421-4dea-b660-424cee906158 tempest-VolumesActionsTest-377483160 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:54:18 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-f9544127-5421-4dea-b660-424cee906158 tempest-VolumesActionsTest-377483160 None] Deleted volume successfully. Sep 04 15:54:18 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f9544127-5421-4dea-b660-424cee906158 tempest-VolumesActionsTest-377483160 None] Lock "cinder-db805747-b7e5-4aa9-afad-f0f0cffcbc94-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:18 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34d8c72b-9db8-41bc-b17c-cbf150f22b8b tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa" returned: 0 in 0.435s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:18 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-34d8c72b-9db8-41bc-b17c-cbf150f22b8b tempest-VolumesSnapshotListTestJSON-2084216790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0775eb48-bedd-4345-8aab-e8584601c487(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:54:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34d8c72b-9db8-41bc-b17c-cbf150f22b8b tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:18 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a 1G Sep 04 15:54:18 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:19 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34d8c72b-9db8-41bc-b17c-cbf150f22b8b tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a 1G" returned: 0 in 0.526s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34d8c72b-9db8-41bc-b17c-cbf150f22b8b tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:19 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a Sep 04 15:54:19 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:19 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34d8c72b-9db8-41bc-b17c-cbf150f22b8b tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a" returned: 0 in 0.304s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:19 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-34d8c72b-9db8-41bc-b17c-cbf150f22b8b tempest-VolumesSnapshotListTestJSON-2084216790 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a is being set with open permissions: ugo+rw Sep 04 15:54:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34d8c72b-9db8-41bc-b17c-cbf150f22b8b tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:19 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a Sep 04 15:54:19 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:19 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34d8c72b-9db8-41bc-b17c-cbf150f22b8b tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a" returned: 0 in 0.253s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-34d8c72b-9db8-41bc-b17c-cbf150f22b8b tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.626s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:20 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-34d8c72b-9db8-41bc-b17c-cbf150f22b8b tempest-VolumesSnapshotListTestJSON-2084216790 None] Create snapshot completed successfully Sep 04 15:54:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1ff57609-b173-4789-b32c-d1142d82d1c3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1ff57609-b173-4789-b32c-d1142d82d1c3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:20 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-1ff57609-b173-4789-b32c-d1142d82d1c3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Creating offline snapshot d6168c5b-0e75-4ca1-9457-9e8048f2feaa of volume 0775eb48-bedd-4345-8aab-e8584601c487 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:54:20 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbcc47c-dff0-4538-9d2a-adcf83d0a73a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1ff57609-b173-4789-b32c-d1142d82d1c3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:20 devstack sudo[93806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a Sep 04 15:54:20 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:21 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1ff57609-b173-4789-b32c-d1142d82d1c3 tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a" returned: 0 in 0.399s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:21 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-1ff57609-b173-4789-b32c-d1142d82d1c3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0775eb48-bedd-4345-8aab-e8584601c487(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:54:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1ff57609-b173-4789-b32c-d1142d82d1c3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.d6168c5b-0e75-4ca1-9457-9e8048f2feaa 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:21 devstack sudo[93811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.d6168c5b-0e75-4ca1-9457-9e8048f2feaa 1G Sep 04 15:54:21 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:21 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1ff57609-b173-4789-b32c-d1142d82d1c3 tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.d6168c5b-0e75-4ca1-9457-9e8048f2feaa 1G" returned: 0 in 0.448s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1ff57609-b173-4789-b32c-d1142d82d1c3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.d6168c5b-0e75-4ca1-9457-9e8048f2feaa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:21 devstack sudo[93822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.d6168c5b-0e75-4ca1-9457-9e8048f2feaa Sep 04 15:54:21 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:21 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1ff57609-b173-4789-b32c-d1142d82d1c3 tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.d6168c5b-0e75-4ca1-9457-9e8048f2feaa" returned: 0 in 0.285s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:21 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-1ff57609-b173-4789-b32c-d1142d82d1c3 tempest-VolumesSnapshotListTestJSON-2084216790 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.d6168c5b-0e75-4ca1-9457-9e8048f2feaa is being set with open permissions: ugo+rw Sep 04 15:54:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1ff57609-b173-4789-b32c-d1142d82d1c3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.d6168c5b-0e75-4ca1-9457-9e8048f2feaa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:21 devstack sudo[93827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.d6168c5b-0e75-4ca1-9457-9e8048f2feaa Sep 04 15:54:21 devstack sudo[93827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:22 devstack sudo[93827]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1ff57609-b173-4789-b32c-d1142d82d1c3 tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.d6168c5b-0e75-4ca1-9457-9e8048f2feaa" returned: 0 in 0.269s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1ff57609-b173-4789-b32c-d1142d82d1c3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.519s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:22 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-1ff57609-b173-4789-b32c-d1142d82d1c3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Create snapshot completed successfully Sep 04 15:54:23 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] Acquiring lock "cinder-d6168c5b-0e75-4ca1-9457-9e8048f2feaa-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:23 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-d6168c5b-0e75-4ca1-9457-9e8048f2feaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:23 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] Acquiring lock "cinder-quobyte-0775eb48-bedd-4345-8aab-e8584601c487" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:23 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-quobyte-0775eb48-bedd-4345-8aab-e8584601c487" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:23 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] Acquiring lock "cinder-quobyte-d6168c5b-0e75-4ca1-9457-9e8048f2feaa" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:23 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-quobyte-d6168c5b-0e75-4ca1-9457-9e8048f2feaa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] Deleting offline snapshot d6168c5b-0e75-4ca1-9457-9e8048f2feaa of volume 0775eb48-bedd-4345-8aab-e8584601c487 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:54:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] snapshot_file for this snap is: volume-0775eb48-bedd-4345-8aab-e8584601c487.d6168c5b-0e75-4ca1-9457-9e8048f2feaa {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:54:23 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0ab901-4e4a-4b3c-b6c4-98c72ad1a752]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.d6168c5b-0e75-4ca1-9457-9e8048f2feaa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:23 devstack sudo[93832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.d6168c5b-0e75-4ca1-9457-9e8048f2feaa Sep 04 15:54:23 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:24 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.d6168c5b-0e75-4ca1-9457-9e8048f2feaa" returned: 0 in 0.371s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:24 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0775eb48-bedd-4345-8aab-e8584601c487(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:54:24 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[801fce72-9937-41c0-9714-7bb78f6cda5b]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:24 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a Sep 04 15:54:24 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:24 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a" returned: 0 in 0.400s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:24 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0775eb48-bedd-4345-8aab-e8584601c487(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:54:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.d6168c5b-0e75-4ca1-9457-9e8048f2feaa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:24 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.d6168c5b-0e75-4ca1-9457-9e8048f2feaa Sep 04 15:54:24 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:25 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.d6168c5b-0e75-4ca1-9457-9e8048f2feaa" returned: 0 in 0.507s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.d6168c5b-0e75-4ca1-9457-9e8048f2feaa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:25 devstack sudo[93848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.d6168c5b-0e75-4ca1-9457-9e8048f2feaa Sep 04 15:54:25 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:25 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.d6168c5b-0e75-4ca1-9457-9e8048f2feaa" returned: 0 in 0.280s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-quobyte-d6168c5b-0e75-4ca1-9457-9e8048f2feaa" released by "_delete_snapshot" :: held 1.680s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-quobyte-0775eb48-bedd-4345-8aab-e8584601c487" released by "delete_snapshot" :: held 1.703s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:25 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] Created reservations ['e3f7541d-ca7e-4fb1-aa4e-49f8f1d70241', '81658d5d-7a42-4dc8-80ec-6bfe9e9040e1', '9b5b4db3-19d7-4a4d-99aa-920bc8e048f7', '81e85dc3-edf2-4431-960d-1f09f0724191'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:54:25 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] Delete snapshot completed successfully. Sep 04 15:54:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-080f689b-f2b4-495c-99f4-075775ccac0f tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-d6168c5b-0e75-4ca1-9457-9e8048f2feaa-delete_snapshot" released by "delete_snapshot" :: held 1.885s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] Acquiring lock "cinder-c2e5bf98-303a-4ce7-98b7-9ddb6f96169a-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-c2e5bf98-303a-4ce7-98b7-9ddb6f96169a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] Acquiring lock "cinder-quobyte-0775eb48-bedd-4345-8aab-e8584601c487" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-quobyte-0775eb48-bedd-4345-8aab-e8584601c487" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] Acquiring lock "cinder-quobyte-c2e5bf98-303a-4ce7-98b7-9ddb6f96169a" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-quobyte-c2e5bf98-303a-4ce7-98b7-9ddb6f96169a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] Deleting offline snapshot c2e5bf98-303a-4ce7-98b7-9ddb6f96169a of volume 0775eb48-bedd-4345-8aab-e8584601c487 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:54:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] snapshot_file for this snap is: volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:54:26 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[056adc81-2d6e-4d2f-b275-b2ca64540c9f]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:26 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a Sep 04 15:54:26 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:26 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a" returned: 0 in 0.382s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0775eb48-bedd-4345-8aab-e8584601c487(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:54:26 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e087a9b-5453-4199-a407-6f435cc79a1c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:26 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa Sep 04 15:54:26 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:26 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa" returned: 0 in 0.478s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0775eb48-bedd-4345-8aab-e8584601c487(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:54:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:26 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a Sep 04 15:54:26 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:27 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a" returned: 0 in 0.440s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:27 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a Sep 04 15:54:27 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:27 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.c2e5bf98-303a-4ce7-98b7-9ddb6f96169a" returned: 0 in 0.265s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-quobyte-c2e5bf98-303a-4ce7-98b7-9ddb6f96169a" released by "_delete_snapshot" :: held 1.670s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-quobyte-0775eb48-bedd-4345-8aab-e8584601c487" released by "delete_snapshot" :: held 1.695s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:27 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] Created reservations ['6f1a35ee-c776-46e5-ae4d-d395c198648d', '558e09b8-0672-4e9a-baa5-4fc8d659a2ab', 'c9fe674a-ff43-4b5b-b61a-a924f50b5914', '4d1fadec-6ae4-494b-bd1b-8ae391c6e593'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:54:27 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] Delete snapshot completed successfully. Sep 04 15:54:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-fa56892c-0466-4017-841d-e97e5efbd17d tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-c2e5bf98-303a-4ce7-98b7-9ddb6f96169a-delete_snapshot" released by "delete_snapshot" :: held 1.867s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] Acquiring lock "cinder-b7321b46-fa2e-4c63-bb1e-c44f05fc06aa-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-b7321b46-fa2e-4c63-bb1e-c44f05fc06aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] Acquiring lock "cinder-quobyte-0775eb48-bedd-4345-8aab-e8584601c487" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-quobyte-0775eb48-bedd-4345-8aab-e8584601c487" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] Acquiring lock "cinder-quobyte-b7321b46-fa2e-4c63-bb1e-c44f05fc06aa" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-quobyte-b7321b46-fa2e-4c63-bb1e-c44f05fc06aa" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] Deleting offline snapshot b7321b46-fa2e-4c63-bb1e-c44f05fc06aa of volume 0775eb48-bedd-4345-8aab-e8584601c487 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] snapshot_file for this snap is: volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d701bf-efb1-42ab-b534-8b9b67cb5b9c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:28 devstack sudo[93874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa Sep 04 15:54:28 devstack sudo[93874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:28 devstack sudo[93874]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa" returned: 0 in 0.447s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0775eb48-bedd-4345-8aab-e8584601c487(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[106af458-c1b2-4708-93e4-5b3dc8de3252]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Flow 'volume_create_manager' (34639b8c-9776-4853-86c2-1875d33e53ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:28 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487 Sep 04 15:54:28 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69810923-5d07-4bc5-9ea1-a62087fef037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69810923-5d07-4bc5-9ea1-a62087fef037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2096974758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b63badb0c6422982a9cdebcc76218f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:29Z,use_quota=True,user_id='3040dd7451d64788aeea3c511d6b6abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12300b6-7592-4da8-9655-809789f44cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12300b6-7592-4da8-9655-809789f44cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07cf504-0b44-43a8-b77b-a74fe21b392c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07cf504-0b44-43a8-b77b-a74fe21b392c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd567fb51-ee0d-4ee6-bef7-ed52e9bd26d4', 'volume_name': 'volume-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0b88bc-fa51-4f79-b368-e3d6be681fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0b88bc-fa51-4f79-b368-e3d6be681fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d1a965-c3ad-4fa0-ab13-dd62b7ba34dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:28 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Volume d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4', 'volume_size': 1} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2096974758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b63badb0c6422982a9cdebcc76218f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:29Z,use_quota=True,user_id='3040dd7451d64788aeea3c511d6b6abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Creating volume d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:54:28 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:54:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:28 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4 1073741824 Sep 04 15:54:28 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:29 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487" returned: 0 in 0.410s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:29 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa Sep 04 15:54:29 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:29 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4 1073741824" returned: 0 in 0.504s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:29 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4 Sep 04 15:54:29 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:29 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa" returned: 0 in 0.402s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:29 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa Sep 04 15:54:29 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:29 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4" returned: 0 in 0.278s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:29 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:54:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:29 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487.b7321b46-fa2e-4c63-bb1e-c44f05fc06aa" returned: 0 in 0.264s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d1a965-c3ad-4fa0-ab13-dd62b7ba34dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb9874c-5dbe-4e4a-b342-c44fce138fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:29 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Volume volume-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4 (d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4): created successfully Sep 04 15:54:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb9874c-5dbe-4e4a-b342-c44fce138fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Flow 'volume_create_manager' (34639b8c-9776-4853-86c2-1875d33e53ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:29 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-quobyte-b7321b46-fa2e-4c63-bb1e-c44f05fc06aa" released by "_delete_snapshot" :: held 1.702s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:29 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-quobyte-0775eb48-bedd-4345-8aab-e8584601c487" released by "delete_snapshot" :: held 1.730s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:29 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e155faac-73da-40de-aafb-31d306d6ba0d tempest-AttachVolumeNegativeTest-875161899 None] Created volume successfully. Sep 04 15:54:29 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] Created reservations ['e4fba082-5cb1-440b-aa9e-b153d602221f', '2379c718-c4fc-458d-9c46-335942a4113a', '4731ff2c-2d1d-4595-9343-641dd7050862', 'a8e55905-66f1-40a6-9a53-388eaec57065'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:54:29 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] Delete snapshot completed successfully. Sep 04 15:54:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0315b03b-30cf-4941-ade6-cd9537aef47e tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-b7321b46-fa2e-4c63-bb1e-c44f05fc06aa-delete_snapshot" released by "delete_snapshot" :: held 1.869s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-32121af5-807c-4a80-9b2c-960f29a662e3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Acquiring lock "cinder-0775eb48-bedd-4345-8aab-e8584601c487-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-32121af5-807c-4a80-9b2c-960f29a662e3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-0775eb48-bedd-4345-8aab-e8584601c487-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-32121af5-807c-4a80-9b2c-960f29a662e3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Acquiring lock "cinder-quobyte-0775eb48-bedd-4345-8aab-e8584601c487" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-32121af5-807c-4a80-9b2c-960f29a662e3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-quobyte-0775eb48-bedd-4345-8aab-e8584601c487" acquired by "delete_volume" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:30 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d98caa8-b272-4ed4-989d-35f6c93052de]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-32121af5-807c-4a80-9b2c-960f29a662e3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:30 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487 Sep 04 15:54:30 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:30 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-32121af5-807c-4a80-9b2c-960f29a662e3 tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487" returned: 0 in 0.388s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-32121af5-807c-4a80-9b2c-960f29a662e3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:30 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487 Sep 04 15:54:30 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:31 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-32121af5-807c-4a80-9b2c-960f29a662e3 tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0775eb48-bedd-4345-8aab-e8584601c487" returned: 0 in 0.302s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:31 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-32121af5-807c-4a80-9b2c-960f29a662e3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-quobyte-0775eb48-bedd-4345-8aab-e8584601c487" released by "delete_volume" :: held 0.751s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:31 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-32121af5-807c-4a80-9b2c-960f29a662e3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Created reservations ['eb77d473-d30c-4182-a94c-641306f3a534', '7c9d0867-5da9-4343-864d-332611cc2414', '33ed51e3-0635-4438-b84c-657435bbb4f1', '23c44a5b-9581-4245-8fe0-d43e37a3487c'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:54:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-32121af5-807c-4a80-9b2c-960f29a662e3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-32121af5-807c-4a80-9b2c-960f29a662e3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-32121af5-807c-4a80-9b2c-960f29a662e3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:54:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-32121af5-807c-4a80-9b2c-960f29a662e3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:54:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-32121af5-807c-4a80-9b2c-960f29a662e3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-32121af5-807c-4a80-9b2c-960f29a662e3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:31 devstack sudo[93915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:54:31 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-7892108d-d0d5-42fb-b59f-a8ab3e384c76 req-b4fd4149-f7a3-4903-906f-b7157a9e7065 tempest-AttachVolumeNegativeTest-875161899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-7892108d-d0d5-42fb-b59f-a8ab3e384c76 req-b4fd4149-f7a3-4903-906f-b7157a9e7065 tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:31 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24167a4-5615-42bf-a59b-cc0beb847bef]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-7892108d-d0d5-42fb-b59f-a8ab3e384c76 req-b4fd4149-f7a3-4903-906f-b7157a9e7065 tempest-AttachVolumeNegativeTest-875161899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:31 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-32121af5-807c-4a80-9b2c-960f29a662e3 tempest-VolumesSnapshotListTestJSON-2084216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.370s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:31 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-32121af5-807c-4a80-9b2c-960f29a662e3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:54:31 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-32121af5-807c-4a80-9b2c-960f29a662e3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Deleted volume successfully. Sep 04 15:54:31 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-32121af5-807c-4a80-9b2c-960f29a662e3 tempest-VolumesSnapshotListTestJSON-2084216790 None] Lock "cinder-0775eb48-bedd-4345-8aab-e8584601c487-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:31 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4 Sep 04 15:54:31 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:32 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-7892108d-d0d5-42fb-b59f-a8ab3e384c76 req-b4fd4149-f7a3-4903-906f-b7157a9e7065 tempest-AttachVolumeNegativeTest-875161899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4" returned: 0 in 0.422s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-7892108d-d0d5-42fb-b59f-a8ab3e384c76 req-b4fd4149-f7a3-4903-906f-b7157a9e7065 tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.451s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-7892108d-d0d5-42fb-b59f-a8ab3e384c76 req-b4fd4149-f7a3-4903-906f-b7157a9e7065 tempest-AttachVolumeNegativeTest-875161899 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1bcd4d09-f856-41c3-8152-cfdd09d80c70', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:54:32 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-7892108d-d0d5-42fb-b59f-a8ab3e384c76 req-b4fd4149-f7a3-4903-906f-b7157a9e7065 tempest-AttachVolumeNegativeTest-875161899 None] attachment_update completed successfully. Sep 04 15:54:33 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-0ce2aa10-1179-4e18-8732-9284fbf6bb00 req-919684bd-a338-44e7-b517-e0cddf576b64 tempest-ServerActionsTestOtherA-1231278264 None] Terminate volume connection completed successfully. Sep 04 15:54:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-0ce2aa10-1179-4e18-8732-9284fbf6bb00 req-919684bd-a338-44e7-b517-e0cddf576b64 tempest-ServerActionsTestOtherA-1231278264 None] Deleting attachment b436dd11-82a7-4696-b241-8a560b66320b. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Flow 'volume_create_manager' (78531c7d-a359-4011-a282-96aa880983af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739d9128-6c3c-4be2-9aa1-21b4133b40b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739d9128-6c3c-4be2-9aa1-21b4133b40b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-454679456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad2bf6d-af0a-498c-907a-0136ef62451c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735c3c8f8f4f44afa7bc39b61dd8a23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:35Z,use_quota=True,user_id='0baf252bfd1c4806a2a0f55356b0161b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (881fd4bb-bc22-43ae-a997-1c12efa27d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (881fd4bb-bc22-43ae-a997-1c12efa27d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7e26ff-6a20-4802-b7a7-ead140a9a448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7e26ff-6a20-4802-b7a7-ead140a9a448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ad2bf6d-af0a-498c-907a-0136ef62451c', 'volume_name': 'volume-1ad2bf6d-af0a-498c-907a-0136ef62451c', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1748ee9-3283-4959-af4e-c803bf0b019a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1748ee9-3283-4959-af4e-c803bf0b019a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90894933-7141-4a9c-beff-4dd758bcd5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:34 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Volume 1ad2bf6d-af0a-498c-907a-0136ef62451c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ad2bf6d-af0a-498c-907a-0136ef62451c', 'volume_size': 1} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-454679456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad2bf6d-af0a-498c-907a-0136ef62451c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735c3c8f8f4f44afa7bc39b61dd8a23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:35Z,use_quota=True,user_id='0baf252bfd1c4806a2a0f55356b0161b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Creating volume 1ad2bf6d-af0a-498c-907a-0136ef62451c {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:54:34 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:34 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c 1073741824 Sep 04 15:54:34 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:34 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:54:34 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:35 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.410s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:54:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:54:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 28 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:54:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:54:35 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c 1073741824" returned: 0 in 0.714s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:35 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c Sep 04 15:54:35 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:35 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c" returned: 0 in 0.324s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:54:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:36 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90894933-7141-4a9c-beff-4dd758bcd5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ad2bf6d-af0a-498c-907a-0136ef62451c', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:36 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb442c77-53c9-40ad-9693-4a16d7cce4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:36 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Volume volume-1ad2bf6d-af0a-498c-907a-0136ef62451c (1ad2bf6d-af0a-498c-907a-0136ef62451c): created successfully Sep 04 15:54:36 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb442c77-53c9-40ad-9693-4a16d7cce4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:36 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Flow 'volume_create_manager' (78531c7d-a359-4011-a282-96aa880983af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:36 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-dbdb1d77-19f9-4a01-8dc0-9b4cac3b7ee7 tempest-VolumesDeleteCascade-80220957 None] Created volume successfully. Sep 04 15:54:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3d4c71e4-0d75-4872-9634-4c6a9a6cd809 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3d4c71e4-0d75-4872-9634-4c6a9a6cd809 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-3d4c71e4-0d75-4872-9634-4c6a9a6cd809 tempest-VolumesDeleteCascade-80220957 None] Creating offline snapshot 42f175ae-2e6e-4273-8878-59413f0569ae of volume 1ad2bf6d-af0a-498c-907a-0136ef62451c {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:54:37 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4e12ed-aed3-4a47-bf37-d7b60731621a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3d4c71e4-0d75-4872-9634-4c6a9a6cd809 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:37 devstack sudo[93977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c Sep 04 15:54:37 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:37 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3d4c71e4-0d75-4872-9634-4c6a9a6cd809 tempest-VolumesDeleteCascade-80220957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c" returned: 0 in 0.444s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3d4c71e4-0d75-4872-9634-4c6a9a6cd809 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:37 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae 1G Sep 04 15:54:37 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:38 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3d4c71e4-0d75-4872-9634-4c6a9a6cd809 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae 1G" returned: 0 in 0.493s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3d4c71e4-0d75-4872-9634-4c6a9a6cd809 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad2bf6d-af0a-498c-907a-0136ef62451c -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:38 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad2bf6d-af0a-498c-907a-0136ef62451c -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae Sep 04 15:54:38 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:38 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3d4c71e4-0d75-4872-9634-4c6a9a6cd809 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad2bf6d-af0a-498c-907a-0136ef62451c -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae" returned: 0 in 0.461s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:38 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-3d4c71e4-0d75-4872-9634-4c6a9a6cd809 tempest-VolumesDeleteCascade-80220957 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae is being set with open permissions: ugo+rw Sep 04 15:54:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3d4c71e4-0d75-4872-9634-4c6a9a6cd809 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:38 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae Sep 04 15:54:38 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:38 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3d4c71e4-0d75-4872-9634-4c6a9a6cd809 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae" returned: 0 in 0.343s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3d4c71e4-0d75-4872-9634-4c6a9a6cd809 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:38 devstack sudo[93999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.info Sep 04 15:54:38 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:39 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3d4c71e4-0d75-4872-9634-4c6a9a6cd809 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.info" returned: 0 in 0.352s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:39 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-3d4c71e4-0d75-4872-9634-4c6a9a6cd809 tempest-VolumesDeleteCascade-80220957 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.info is being set with open permissions: ugo+rw Sep 04 15:54:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3d4c71e4-0d75-4872-9634-4c6a9a6cd809 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:39 devstack sudo[94005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.info Sep 04 15:54:39 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:39 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3d4c71e4-0d75-4872-9634-4c6a9a6cd809 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.info" returned: 0 in 0.307s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3d4c71e4-0d75-4872-9634-4c6a9a6cd809 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.556s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:39 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-3d4c71e4-0d75-4872-9634-4c6a9a6cd809 tempest-VolumesDeleteCascade-80220957 None] Create snapshot completed successfully Sep 04 15:54:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-759b1422-7c88-44b6-8d6a-1edf8963a237 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-759b1422-7c88-44b6-8d6a-1edf8963a237 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-759b1422-7c88-44b6-8d6a-1edf8963a237 tempest-VolumesDeleteCascade-80220957 None] Creating offline snapshot 84f75cb1-3a1a-43cf-9220-43d34d946eb4 of volume 1ad2bf6d-af0a-498c-907a-0136ef62451c {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:54:40 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[4defc48b-2356-4217-8504-71da4b6ede2d]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-759b1422-7c88-44b6-8d6a-1edf8963a237 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:40 devstack sudo[94009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae Sep 04 15:54:40 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:40 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-759b1422-7c88-44b6-8d6a-1edf8963a237 tempest-VolumesDeleteCascade-80220957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae" returned: 0 in 0.473s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-759b1422-7c88-44b6-8d6a-1edf8963a237 tempest-VolumesDeleteCascade-80220957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ad2bf6d-af0a-498c-907a-0136ef62451c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:54:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-759b1422-7c88-44b6-8d6a-1edf8963a237 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:40 devstack sudo[94015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4 1G Sep 04 15:54:40 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:41 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-759b1422-7c88-44b6-8d6a-1edf8963a237 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4 1G" returned: 0 in 0.820s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-759b1422-7c88-44b6-8d6a-1edf8963a237 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:41 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4 Sep 04 15:54:41 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:42 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-759b1422-7c88-44b6-8d6a-1edf8963a237 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4" returned: 0 in 0.492s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:42 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-759b1422-7c88-44b6-8d6a-1edf8963a237 tempest-VolumesDeleteCascade-80220957 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4 is being set with open permissions: ugo+rw Sep 04 15:54:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-759b1422-7c88-44b6-8d6a-1edf8963a237 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:42 devstack sudo[94046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4 Sep 04 15:54:42 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:42 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-759b1422-7c88-44b6-8d6a-1edf8963a237 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4" returned: 0 in 0.444s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-759b1422-7c88-44b6-8d6a-1edf8963a237 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.355s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:42 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:54:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Flow 'volume_create_manager' (bd59b529-0418-4397-9241-503e8b834337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc8992f-7407-4bcc-b355-473c90ade8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:42 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-759b1422-7c88-44b6-8d6a-1edf8963a237 tempest-VolumesDeleteCascade-80220957 None] Create snapshot completed successfully Sep 04 15:54:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc8992f-7407-4bcc-b355-473c90ade8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1639704703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b6b3bb-4328-42c1-8d1c-6724126706be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41728d06bb99480db0b96e3d2c2f066f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:43Z,use_quota=True,user_id='e435bdf46696415ab0b940ee4ff0d282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e43ed4f-1289-45cb-8003-8fcdd0ff1032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e43ed4f-1289-45cb-8003-8fcdd0ff1032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5723d8e1-f96e-4ec5-aef4-f2449263318f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:42 devstack cinder-volume[87513]: DEBUG cinder.image.glance [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Creating Keystone auth plugin from conf {{(pid=87513) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 15:54:43 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5723d8e1-f96e-4ec5-aef4-f2449263318f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a6b6b3bb-4328-42c1-8d1c-6724126706be', 'volume_name': 'volume-a6b6b3bb-4328-42c1-8d1c-6724126706be', 'volume_size': 1, 'image_id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '32b22b5244654820a43b7715eda03c1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:43 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1569988-2416-4df9-ae6b-c8264bbd46a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:43 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1569988-2416-4df9-ae6b-c8264bbd46a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:43 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139a7419-45fc-4a6b-b5fb-ca46eaa3dbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:43 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Volume a6b6b3bb-4328-42c1-8d1c-6724126706be: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a6b6b3bb-4328-42c1-8d1c-6724126706be', 'volume_size': 1, 'image_id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '32b22b5244654820a43b7715eda03c1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 15:54:43 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Trying to clone a6b6b3bb-4328-42c1-8d1c-6724126706be from image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}]). {{(pid=87513) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 15:54:43 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_stwt39yodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 15:54:43 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Image download 20.69 MB at 20.69 MB/s Sep 04 15:54:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "cinder-1ad2bf6d-af0a-498c-907a-0136ef62451c-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-1ad2bf6d-af0a-498c-907a-0136ef62451c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:43 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[7334412d-4d3d-40b8-9f0a-5ae0d9ce45e1]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_stwt39yodevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:43 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Performing cascade delete. {{(pid=87513) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 04 15:54:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "cinder-42f175ae-2e6e-4273-8878-59413f0569ae-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-42f175ae-2e6e-4273-8878-59413f0569ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "cinder-quobyte-1ad2bf6d-af0a-498c-907a-0136ef62451c" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-1ad2bf6d-af0a-498c-907a-0136ef62451c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "cinder-quobyte-42f175ae-2e6e-4273-8878-59413f0569ae" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-42f175ae-2e6e-4273-8878-59413f0569ae" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Deleting offline snapshot 42f175ae-2e6e-4273-8878-59413f0569ae of volume 1ad2bf6d-af0a-498c-907a-0136ef62451c {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:54:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] snapshot_file for this snap is: volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:54:44 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c906cb65-e612-4827-8cb3-d36361c92617]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:44 devstack sudo[94053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_stwt39yodevstack@QuobyteHD Sep 04 15:54:44 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:44 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae Sep 04 15:54:44 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:44 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_stwt39yodevstack@QuobyteHD" returned: 0 in 0.567s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:44 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Temporary image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 is fetched for user e435bdf46696415ab0b940ee4ff0d282. {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 15:54:44 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df35eb4-ddde-4b8b-9b5f-761d1273c1cc]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_stwt39yodevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:44 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae" returned: 0 in 0.550s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ad2bf6d-af0a-498c-907a-0136ef62451c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:54:44 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccd8a9a-637d-4d0f-8963-e160cc52b398]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:44 devstack sudo[94064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_stwt39yodevstack@QuobyteHD Sep 04 15:54:44 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:44 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c Sep 04 15:54:44 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:45 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_stwt39yodevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1639704703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b6b3bb-4328-42c1-8d1c-6724126706be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41728d06bb99480db0b96e3d2c2f066f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:43Z,use_quota=True,user_id='e435bdf46696415ab0b940ee4ff0d282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:54:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Creating volume a6b6b3bb-4328-42c1-8d1c-6724126706be {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:54:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:54:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:54:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:54:45 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:54:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:45 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be 1073741824 Sep 04 15:54:45 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:45 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c" returned: 0 in 0.553s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:45 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2d2d18-e0b5-490b-8948-35d7d0763bbd]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:45 devstack sudo[94088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4 Sep 04 15:54:45 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:45 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be 1073741824" returned: 0 in 0.685s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:45 devstack sudo[94102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be Sep 04 15:54:45 devstack sudo[94102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:45 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4" returned: 0 in 0.700s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ad2bf6d-af0a-498c-907a-0136ef62451c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:54:45 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45dd195-dd42-463b-b141-7bc99a5cf7a2]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:46 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae Sep 04 15:54:46 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:46 devstack sudo[94102]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be" returned: 0 in 0.399s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:54:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:46 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Attempting download of 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}])) to volume a6b6b3bb-4328-42c1-8d1c-6724126706be. {{(pid=87513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 15:54:46 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dce225-1487-4daf-853a-155b2e062078]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_22das7pn {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:46 devstack sudo[94107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_22das7pn Sep 04 15:54:46 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:46 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae" returned: 0 in 0.548s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ad2bf6d-af0a-498c-907a-0136ef62451c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:54:46 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d8da46-1aaf-478f-8d14-f0865c6e61ad]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:46 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c Sep 04 15:54:46 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:46 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_22das7pn" returned: 0 in 0.415s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_22das7pn {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:46 devstack sudo[94116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_22das7pn Sep 04 15:54:46 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:46 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c" returned: 0 in 0.437s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:47 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae Sep 04 15:54:47 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:47 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_22das7pn" returned: 1 in 0.559s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_22das7pn' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:54:47 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9bfc24-ec5e-48cc-9a34-c72911f39ab3]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_stwt39yodevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:47 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_stwt39yodevstack@QuobyteHD Sep 04 15:54:47 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:47 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae" returned: 0 in 0.538s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:47 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae Sep 04 15:54:47 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:47 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_stwt39yodevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:47 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 was qcow2, converting to raw {{(pid=87513) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 15:54:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_stwt39yodevstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:47 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_stwt39yodevstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be Sep 04 15:54:47 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:47 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.42f175ae-2e6e-4273-8878-59413f0569ae" returned: 0 in 0.406s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad2bf6d-af0a-498c-907a-0136ef62451c /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4 -F qcow2 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:48 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad2bf6d-af0a-498c-907a-0136ef62451c /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4 -F qcow2 Sep 04 15:54:48 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:48 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ad2bf6d-af0a-498c-907a-0136ef62451c /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4 -F qcow2" returned: 0 in 0.607s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-42f175ae-2e6e-4273-8878-59413f0569ae" released by "_delete_snapshot" :: held 4.606s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-1ad2bf6d-af0a-498c-907a-0136ef62451c" released by "delete_snapshot" :: held 4.648s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:48 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Created reservations ['ccf0cbab-1f2a-4b74-80aa-accfe59189e0', 'c992835d-63b3-4387-b20f-62a21a677758', 'b753e6df-3ac3-4154-bdbc-39ed42de74d4', '341a0406-c623-4676-88a6-3b497c791b7b'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:54:48 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Delete snapshot completed successfully. Sep 04 15:54:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-42f175ae-2e6e-4273-8878-59413f0569ae-delete_snapshot" released by "delete_snapshot" :: held 4.990s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "cinder-84f75cb1-3a1a-43cf-9220-43d34d946eb4-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-84f75cb1-3a1a-43cf-9220-43d34d946eb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "cinder-quobyte-1ad2bf6d-af0a-498c-907a-0136ef62451c" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:49 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-1ad2bf6d-af0a-498c-907a-0136ef62451c" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:49 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "cinder-quobyte-84f75cb1-3a1a-43cf-9220-43d34d946eb4" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:49 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-84f75cb1-3a1a-43cf-9220-43d34d946eb4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:49 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Deleting offline snapshot 84f75cb1-3a1a-43cf-9220-43d34d946eb4 of volume 1ad2bf6d-af0a-498c-907a-0136ef62451c {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:54:49 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] snapshot_file for this snap is: volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:54:49 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e671abd4-5e66-48a9-a21e-d9a62f55a14d]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:49 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4 Sep 04 15:54:49 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:49 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4" returned: 0 in 0.720s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:49 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ad2bf6d-af0a-498c-907a-0136ef62451c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:54:49 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[46203e3c-e6b4-49ea-914b-79e426365782]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:50 devstack sudo[94193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c Sep 04 15:54:50 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:50 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c" returned: 0 in 0.688s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:50 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4 Sep 04 15:54:50 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:50 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_stwt39yodevstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be" returned: 0 in 2.849s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:50 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_stwt39yodevstack@QuobyteHD, size 112.00 MB, duration 2.85 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:54:50 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Converted 112.00 MB image at 39.29 MB/s Sep 04 15:54:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:50 devstack sudo[94203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be 1G Sep 04 15:54:50 devstack sudo[94203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:51 devstack sudo[94203]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be 1G" returned: 0 in 0.627s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:51 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78aaad1-b5af-4f7e-bf9c-b2dd78c3ace6]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:51 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4" returned: 0 in 0.829s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:51 devstack sudo[94212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be Sep 04 15:54:51 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:51 devstack sudo[94214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4 Sep 04 15:54:51 devstack sudo[94214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:51 devstack sudo[94214]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c.84f75cb1-3a1a-43cf-9220-43d34d946eb4" returned: 0 in 0.478s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:51 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:51 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-84f75cb1-3a1a-43cf-9220-43d34d946eb4" released by "_delete_snapshot" :: held 2.919s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be" returned: 0 in 0.622s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:51 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-1ad2bf6d-af0a-498c-907a-0136ef62451c" released by "delete_snapshot" :: held 2.963s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:52 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Created reservations ['ad208f0a-a5bb-4476-a097-f34cea3a7129', '1ed9fbab-b517-47f2-a8ff-51e731698f4b', '325db81a-5134-4dda-b1e9-99b9ec8b85a7', 'e15c0ea5-3288-48cb-b143-18ddaf3d52cc'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:54:52 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be Sep 04 15:54:52 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:52 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Delete snapshot completed successfully. Sep 04 15:54:52 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-84f75cb1-3a1a-43cf-9220-43d34d946eb4-delete_snapshot" released by "delete_snapshot" :: held 3.243s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Snapshots deleted, issuing volume delete {{(pid=87513) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 04 15:54:52 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "cinder-quobyte-1ad2bf6d-af0a-498c-907a-0136ef62451c" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:52 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-1ad2bf6d-af0a-498c-907a-0136ef62451c" acquired by "delete_volume" :: waited 0.035s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:52 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7459e32-1af4-481b-9125-6cd60fa13c5e]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:52 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c Sep 04 15:54:52 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:52 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be" returned: 1 in 0.518s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:54:52 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Downloaded image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}])) to volume a6b6b3bb-4328-42c1-8d1c-6724126706be successfully. {{(pid=87513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 15:54:52 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Temporary image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 for user e435bdf46696415ab0b940ee4ff0d282 is deleted. {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 15:54:52 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Marking volume a6b6b3bb-4328-42c1-8d1c-6724126706be as bootable. {{(pid=87513) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 15:54:52 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Copying metadata from image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 to a6b6b3bb-4328-42c1-8d1c-6724126706be. {{(pid=87513) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 15:54:52 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Creating volume glance metadata for volume a6b6b3bb-4328-42c1-8d1c-6724126706be backed by image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87513) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 15:54:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139a7419-45fc-4a6b-b5fb-ca46eaa3dbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6b6b3bb-4328-42c1-8d1c-6724126706be', 'volume_size': 1, 'image_id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '32b22b5244654820a43b7715eda03c1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee68d464-2e56-4efb-91fb-2b33d578645f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:52 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Volume volume-a6b6b3bb-4328-42c1-8d1c-6724126706be (a6b6b3bb-4328-42c1-8d1c-6724126706be): created successfully Sep 04 15:54:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee68d464-2e56-4efb-91fb-2b33d578645f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Flow 'volume_create_manager' (bd59b529-0418-4397-9241-503e8b834337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:52 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ef1abb5c-d127-4aa9-a7b5-518807644e72 tempest-ServerActionsTestOtherA-1231278264 None] Created volume successfully. Sep 04 15:54:53 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c" returned: 0 in 0.794s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:53 devstack sudo[94230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c Sep 04 15:54:53 devstack sudo[94230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:53 devstack sudo[94230]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1ad2bf6d-af0a-498c-907a-0136ef62451c" returned: 0 in 0.402s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:53 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-1ad2bf6d-af0a-498c-907a-0136ef62451c" released by "delete_volume" :: held 1.288s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:53 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Created reservations ['8586c72d-76d5-435b-b991-866bfed89aac', 'a961ce95-74c3-4f0e-8787-b3b2a41645ef', 'e2aa9cd3-7974-4c10-b9dd-2e813d7ad84a', 'b0d5f369-75c9-4592-b86d-9c1115f3b29e'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:54:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:53 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:54:53 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:54:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:53 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:54:53 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:53 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.272s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:53 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:54:53 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Deleted volume successfully. Sep 04 15:54:53 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-68bcf1ab-8dba-4928-bff4-d65c820161a9 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-1ad2bf6d-af0a-498c-907a-0136ef62451c-delete_volume" released by "delete_volume" :: held 10.221s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:54 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:54:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Flow 'volume_create_manager' (6ea87a2b-894f-4795-b285-4f216ae495b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98183483-fe45-4b0e-ab18-001ce148aa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98183483-fe45-4b0e-ab18-001ce148aa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-349624171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fa17b10-c415-4690-b009-18cbb3a31f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735c3c8f8f4f44afa7bc39b61dd8a23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:55Z,use_quota=True,user_id='0baf252bfd1c4806a2a0f55356b0161b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0cd16ec-e504-4b19-a337-421522707bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0cd16ec-e504-4b19-a337-421522707bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c8322f-fbd5-434f-aef7-b18dcea61728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c8322f-fbd5-434f-aef7-b18dcea61728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fa17b10-c415-4690-b009-18cbb3a31f8a', 'volume_name': 'volume-1fa17b10-c415-4690-b009-18cbb3a31f8a', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466e636b-549e-4835-930f-df1390310a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466e636b-549e-4835-930f-df1390310a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b561df3c-88f1-47a0-8e67-d95f5f78006c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:55 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Volume 1fa17b10-c415-4690-b009-18cbb3a31f8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fa17b10-c415-4690-b009-18cbb3a31f8a', 'volume_size': 1} Sep 04 15:54:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-349624171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fa17b10-c415-4690-b009-18cbb3a31f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735c3c8f8f4f44afa7bc39b61dd8a23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:55Z,use_quota=True,user_id='0baf252bfd1c4806a2a0f55356b0161b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:54:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Creating volume 1fa17b10-c415-4690-b009-18cbb3a31f8a {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:54:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:54:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:54:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:54:55 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:54:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:55 devstack sudo[94239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a 1073741824 Sep 04 15:54:55 devstack sudo[94239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:55 devstack sudo[94239]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a 1073741824" returned: 0 in 0.497s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:55 devstack sudo[94245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a Sep 04 15:54:55 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:56 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a" returned: 0 in 0.459s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:54:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b561df3c-88f1-47a0-8e67-d95f5f78006c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fa17b10-c415-4690-b009-18cbb3a31f8a', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8c189d-9a8a-4afa-bb3b-79252b6b17b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:56 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Volume volume-1fa17b10-c415-4690-b009-18cbb3a31f8a (1fa17b10-c415-4690-b009-18cbb3a31f8a): created successfully Sep 04 15:54:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8c189d-9a8a-4afa-bb3b-79252b6b17b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Flow 'volume_create_manager' (6ea87a2b-894f-4795-b285-4f216ae495b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:56 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-078dd39a-9070-4bfc-98c7-3b7104edfb53 tempest-VolumesDeleteCascade-80220957 None] Created volume successfully. Sep 04 15:54:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2f77e224-cf61-4e30-aca1-716881e6907d tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2f77e224-cf61-4e30-aca1-716881e6907d tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-2f77e224-cf61-4e30-aca1-716881e6907d tempest-VolumesDeleteCascade-80220957 None] Creating offline snapshot 274c70fb-098e-4ec7-be5d-9054cac99a90 of volume 1fa17b10-c415-4690-b009-18cbb3a31f8a {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:54:57 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd33c350-252d-4cda-9e59-7659a272254f]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2f77e224-cf61-4e30-aca1-716881e6907d tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:57 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a Sep 04 15:54:57 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:57 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2f77e224-cf61-4e30-aca1-716881e6907d tempest-VolumesDeleteCascade-80220957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a" returned: 0 in 0.499s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2f77e224-cf61-4e30-aca1-716881e6907d tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:57 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90 1G Sep 04 15:54:57 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:58 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2f77e224-cf61-4e30-aca1-716881e6907d tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90 1G" returned: 0 in 0.667s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2f77e224-cf61-4e30-aca1-716881e6907d tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fa17b10-c415-4690-b009-18cbb3a31f8a -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:58 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fa17b10-c415-4690-b009-18cbb3a31f8a -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90 Sep 04 15:54:58 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-b375f7a6-4161-47fd-9fd8-f76afe706bf5 req-9835cdcf-9aaa-4d51-a826-566ff94d4155 tempest-ServerActionsTestOtherA-1231278264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:59 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2f77e224-cf61-4e30-aca1-716881e6907d tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fa17b10-c415-4690-b009-18cbb3a31f8a -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90" returned: 0 in 0.623s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:59 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-2f77e224-cf61-4e30-aca1-716881e6907d tempest-VolumesDeleteCascade-80220957 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90 is being set with open permissions: ugo+rw Sep 04 15:54:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2f77e224-cf61-4e30-aca1-716881e6907d tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:59 devstack sudo[94276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90 Sep 04 15:54:59 devstack sudo[94276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:59 devstack sudo[94276]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2f77e224-cf61-4e30-aca1-716881e6907d tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90" returned: 0 in 0.396s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:59 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=107,cinder:UPDATE=129,cinder:INSERT=39,cinder:DELETE=11 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:54:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2f77e224-cf61-4e30-aca1-716881e6907d tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:59 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.info Sep 04 15:54:59 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:00 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2f77e224-cf61-4e30-aca1-716881e6907d tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.info" returned: 0 in 0.397s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:00 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-2f77e224-cf61-4e30-aca1-716881e6907d tempest-VolumesDeleteCascade-80220957 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.info is being set with open permissions: ugo+rw Sep 04 15:55:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2f77e224-cf61-4e30-aca1-716881e6907d tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:00 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.info Sep 04 15:55:00 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:00 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2f77e224-cf61-4e30-aca1-716881e6907d tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.info" returned: 0 in 0.311s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2f77e224-cf61-4e30-aca1-716881e6907d tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.026s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-b375f7a6-4161-47fd-9fd8-f76afe706bf5 req-9835cdcf-9aaa-4d51-a826-566ff94d4155 tempest-ServerActionsTestOtherA-1231278264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.400s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:00 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-2f77e224-cf61-4e30-aca1-716881e6907d tempest-VolumesDeleteCascade-80220957 None] Create snapshot completed successfully Sep 04 15:55:00 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[562af083-e470-4b29-bdc9-0b602afcc208]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-b375f7a6-4161-47fd-9fd8-f76afe706bf5 req-9835cdcf-9aaa-4d51-a826-566ff94d4155 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:00 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be Sep 04 15:55:00 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:01 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-b375f7a6-4161-47fd-9fd8-f76afe706bf5 req-9835cdcf-9aaa-4d51-a826-566ff94d4155 tempest-ServerActionsTestOtherA-1231278264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be" returned: 0 in 1.141s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-b375f7a6-4161-47fd-9fd8-f76afe706bf5 req-9835cdcf-9aaa-4d51-a826-566ff94d4155 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:01 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be Sep 04 15:55:01 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:55:02 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Flow 'volume_create_manager' (7a3565d7-e341-4835-a14a-c24e8ebd02b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (defeacd7-083c-4c3b-9c29-8e0ea2a4e105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-b375f7a6-4161-47fd-9fd8-f76afe706bf5 req-9835cdcf-9aaa-4d51-a826-566ff94d4155 tempest-ServerActionsTestOtherA-1231278264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be" returned: 1 in 0.651s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-b375f7a6-4161-47fd-9fd8-f76afe706bf5 req-9835cdcf-9aaa-4d51-a826-566ff94d4155 tempest-ServerActionsTestOtherA-1231278264 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-b375f7a6-4161-47fd-9fd8-f76afe706bf5 req-9835cdcf-9aaa-4d51-a826-566ff94d4155 tempest-ServerActionsTestOtherA-1231278264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.876s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (defeacd7-083c-4c3b-9c29-8e0ea2a4e105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-44805589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f5e7cf-2cd2-46fc-94b9-852a9febc1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735c3c8f8f4f44afa7bc39b61dd8a23a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=274c70fb-098e-4ec7-be5d-9054cac99a90,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:02Z,use_quota=True,user_id='0baf252bfd1c4806a2a0f55356b0161b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4b2de4-9aae-419b-a329-aa6ef84b7d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4b2de4-9aae-419b-a329-aa6ef84b7d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee91eac1-28db-4f6a-8be7-4f8c9a135cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee91eac1-28db-4f6a-8be7-4f8c9a135cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '24f5e7cf-2cd2-46fc-94b9-852a9febc1a0', 'volume_name': 'volume-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0', 'volume_size': 1, 'snapshot_id': '274c70fb-098e-4ec7-be5d-9054cac99a90'}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde9baec-8c30-4435-adfa-88a31988cafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde9baec-8c30-4435-adfa-88a31988cafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715c50e9-9a90-47e5-bdc7-7be4918151de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:02 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Volume 24f5e7cf-2cd2-46fc-94b9-852a9febc1a0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0', 'volume_size': 1, 'snapshot_id': '274c70fb-098e-4ec7-be5d-9054cac99a90'} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "cinder-quobyte-274c70fb-098e-4ec7-be5d-9054cac99a90-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0" by "_create_volume_from_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-b375f7a6-4161-47fd-9fd8-f76afe706bf5 req-9835cdcf-9aaa-4d51-a826-566ff94d4155 tempest-ServerActionsTestOtherA-1231278264 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-a6b6b3bb-4328-42c1-8d1c-6724126706be', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ff7d1d2-b77e-4de4-9b29-59927677c1d1', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-274c70fb-098e-4ec7-be5d-9054cac99a90-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Creating volume 24f5e7cf-2cd2-46fc-94b9-852a9febc1a0 from snapshot 274c70fb-098e-4ec7-be5d-9054cac99a90 {{(pid=87513) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "cinder-quobyte-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0" by "_copy_volume_from_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] snapshot: 274c70fb-098e-4ec7-be5d-9054cac99a90, volume: 24f5e7cf-2cd2-46fc-94b9-852a9febc1a0, {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9319737a-e036-4fe6-816b-094264101847]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:02 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-b375f7a6-4161-47fd-9fd8-f76afe706bf5 req-9835cdcf-9aaa-4d51-a826-566ff94d4155 tempest-ServerActionsTestOtherA-1231278264 None] attachment_update completed successfully. Sep 04 15:55:02 devstack sudo[94665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90 Sep 04 15:55:02 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:03 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90" returned: 0 in 0.761s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fa17b10-c415-4690-b009-18cbb3a31f8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:55:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] will copy from snapshot at /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 04 15:55:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Creating direct copy from snapshot {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 04 15:55:03 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb5f71d-bd13-4d59-b1b1-9d968123ff4c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:03 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a Sep 04 15:55:03 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:04 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a" returned: 0 in 0.653s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:04 devstack cinder-volume[87513]: DEBUG cinder.utils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Path /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0 not found in is_blk_device check {{(pid=87513) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 04 15:55:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:04 devstack sudo[94726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0 Sep 04 15:55:04 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:11 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0" returned: 0 in 7.397s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:11 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca63391-8641-41a0-9e5f-f84e034c4190]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:11 devstack sudo[94751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a Sep 04 15:55:11 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:12 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a" returned: 0 in 1.057s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:12 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Image conversion details: src /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a, size 1024.00 MB, duration 7.40 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0 {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:55:12 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Converted 1024.00 MB image at 138.39 MB/s Sep 04 15:55:12 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0 is being set with open permissions: ugo+rw Sep 04 15:55:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:12 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=101,cinder:INSERT=30,cinder:DELETE=10,cinder:SELECT=105 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:55:12 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0 Sep 04 15:55:12 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:12 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=10,cinder:UPDATE=1 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:55:13 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0" returned: 0 in 0.680s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0" released by "_copy_volume_from_snapshot" :: held 10.736s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-274c70fb-098e-4ec7-be5d-9054cac99a90-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0" released by "_create_volume_from_snapshot" :: held 10.817s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.865s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715c50e9-9a90-47e5-bdc7-7be4918151de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0', 'volume_size': 1, 'snapshot_id': '274c70fb-098e-4ec7-be5d-9054cac99a90'}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb3e70ad-118f-4e4f-943a-1d52cda7e99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:13 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Volume volume-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0 (24f5e7cf-2cd2-46fc-94b9-852a9febc1a0): created successfully Sep 04 15:55:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb3e70ad-118f-4e4f-943a-1d52cda7e99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Flow 'volume_create_manager' (7a3565d7-e341-4835-a14a-c24e8ebd02b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:13 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-d4d0791e-14e5-437a-a989-aa3a5ff1bfb1 tempest-VolumesDeleteCascade-80220957 None] Created volume successfully. Sep 04 15:55:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "cinder-1fa17b10-c415-4690-b009-18cbb3a31f8a-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-1fa17b10-c415-4690-b009-18cbb3a31f8a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Performing cascade delete. {{(pid=87513) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 04 15:55:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "cinder-274c70fb-098e-4ec7-be5d-9054cac99a90-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-274c70fb-098e-4ec7-be5d-9054cac99a90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "cinder-quobyte-1fa17b10-c415-4690-b009-18cbb3a31f8a" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-1fa17b10-c415-4690-b009-18cbb3a31f8a" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "cinder-quobyte-274c70fb-098e-4ec7-be5d-9054cac99a90" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-274c70fb-098e-4ec7-be5d-9054cac99a90" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Deleting offline snapshot 274c70fb-098e-4ec7-be5d-9054cac99a90 of volume 1fa17b10-c415-4690-b009-18cbb3a31f8a {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:55:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] snapshot_file for this snap is: volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:55:14 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be743cc-95be-4ab9-95c7-ab85b58c3bf3]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:14 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90 Sep 04 15:55:14 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:15 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90" returned: 0 in 0.598s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fa17b10-c415-4690-b009-18cbb3a31f8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:55:15 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c839fbb-b5e5-45e4-b06e-d6a442ad0f91]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:15 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a Sep 04 15:55:15 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:15 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a" returned: 0 in 0.697s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:15 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90 Sep 04 15:55:15 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:16 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90" returned: 0 in 0.514s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:16 devstack sudo[94783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90 Sep 04 15:55:16 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:16 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a.274c70fb-098e-4ec7-be5d-9054cac99a90" returned: 0 in 0.366s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-274c70fb-098e-4ec7-be5d-9054cac99a90" released by "_delete_snapshot" :: held 2.415s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-1fa17b10-c415-4690-b009-18cbb3a31f8a" released by "delete_snapshot" :: held 2.472s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:16 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Created reservations ['abb5e552-05d2-442f-b000-dbd7512b3bed', 'cb4a11d7-b183-4429-9bc6-de6b0a838467', 'da08e14a-42ed-4464-861a-c8c60596e238', 'ed194228-bbe4-41ee-b9ba-311b69157077'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:16 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Delete snapshot completed successfully. Sep 04 15:55:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-274c70fb-098e-4ec7-be5d-9054cac99a90-delete_snapshot" released by "delete_snapshot" :: held 2.711s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:16 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Snapshots deleted, issuing volume delete {{(pid=87513) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 04 15:55:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "cinder-quobyte-1fa17b10-c415-4690-b009-18cbb3a31f8a" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-1fa17b10-c415-4690-b009-18cbb3a31f8a" acquired by "delete_volume" :: waited 0.038s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:17 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[799490f2-deac-48e5-8df6-428173818fd6]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:17 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a Sep 04 15:55:17 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:18 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a" returned: 0 in 1.121s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:18 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a Sep 04 15:55:18 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:18 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1fa17b10-c415-4690-b009-18cbb3a31f8a" returned: 0 in 0.563s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:18 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-1fa17b10-c415-4690-b009-18cbb3a31f8a" released by "delete_volume" :: held 1.871s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:19 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Created reservations ['aab4f2cd-cd78-41f4-902d-9287b97f6259', '966f18e5-65c7-4895-aa3d-38dd6a64be8b', '6335d67e-6e62-472b-a46f-7599850b52f5', '7d4bd103-309c-4591-95d5-3cdfeda00267'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:55:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:55:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:19 devstack sudo[94907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:55:19 devstack sudo[94907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:19 devstack sudo[94907]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.618s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:19 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:19 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Deleted volume successfully. Sep 04 15:55:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-783e6936-ee91-4f8f-b056-fd5a4dfda636 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-1fa17b10-c415-4690-b009-18cbb3a31f8a-delete_volume" released by "delete_volume" :: held 5.730s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:20 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6892d466-5078-4573-a7e4-9bec3637a0a7 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "cinder-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:20 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6892d466-5078-4573-a7e4-9bec3637a0a7 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:20 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6892d466-5078-4573-a7e4-9bec3637a0a7 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "cinder-quobyte-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:20 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6892d466-5078-4573-a7e4-9bec3637a0a7 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0" acquired by "delete_volume" :: waited 0.026s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:20 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[715c72bb-ce33-48ed-9d87-0f63d09f3796]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6892d466-5078-4573-a7e4-9bec3637a0a7 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:21 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0 Sep 04 15:55:21 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:21 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6892d466-5078-4573-a7e4-9bec3637a0a7 tempest-VolumesDeleteCascade-80220957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0" returned: 0 in 0.789s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6892d466-5078-4573-a7e4-9bec3637a0a7 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:21 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0 Sep 04 15:55:21 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:21 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-3b8b039c-013d-4f0a-820d-fb3fb5d9fb85 req-7ac2c419-0433-4246-a4cb-7e3a90931bb7 tempest-ServerActionsTestOtherA-1231278264 None] Terminate volume connection completed successfully. Sep 04 15:55:21 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-3b8b039c-013d-4f0a-820d-fb3fb5d9fb85 req-7ac2c419-0433-4246-a4cb-7e3a90931bb7 tempest-ServerActionsTestOtherA-1231278264 None] Deleting attachment 6ff7d1d2-b77e-4de4-9b29-59927677c1d1. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Flow 'volume_create_manager' (21e4dbd2-d23e-4d76-8cec-94e374376778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e78cfa-0750-4b51-aeb6-6e2595ae8b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e78cfa-0750-4b51-aeb6-6e2595ae8b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1247536334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a5387d3-6cf4-4444-a48e-3ee1826fd7b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05bb525016254831a8442431f1d30c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:22Z,use_quota=True,user_id='80afbd7ec80d4166be46e641783a5d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43272dd4-6f88-4e88-ac5a-ed93318d1afc),volume_type_id=43272dd4-6f88-4e88-ac5a-ed93318d1afc)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0b40da-add4-462d-b5f5-c7521d5cb832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0b40da-add4-462d-b5f5-c7521d5cb832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:22 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d04564f6-7273-4262-8200-ed7ed4f9eb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d04564f6-7273-4262-8200-ed7ed4f9eb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a5387d3-6cf4-4444-a48e-3ee1826fd7b4', 'volume_name': 'volume-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea2f8c8-9d75-4804-8ef0-378886f9a158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea2f8c8-9d75-4804-8ef0-378886f9a158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc95bef-a402-483f-8aa4-ab07bcb62ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:22 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Volume 1a5387d3-6cf4-4444-a48e-3ee1826fd7b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4', 'volume_size': 1} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1247536334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a5387d3-6cf4-4444-a48e-3ee1826fd7b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05bb525016254831a8442431f1d30c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:22Z,use_quota=True,user_id='80afbd7ec80d4166be46e641783a5d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43272dd4-6f88-4e88-ac5a-ed93318d1afc),volume_type_id=43272dd4-6f88-4e88-ac5a-ed93318d1afc)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Creating volume 1a5387d3-6cf4-4444-a48e-3ee1826fd7b4 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:55:22 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6892d466-5078-4573-a7e4-9bec3637a0a7 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0" returned: 0 in 0.584s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:22 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4 1073741824 Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6892d466-5078-4573-a7e4-9bec3637a0a7 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-quobyte-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0" released by "delete_volume" :: held 1.451s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:22 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-6892d466-5078-4573-a7e4-9bec3637a0a7 tempest-VolumesDeleteCascade-80220957 None] Created reservations ['24c6c9ac-3421-45a4-9013-ff6ca13827fc', '75690482-6425-4134-8ee3-83030a7f62ac', '0948e8ce-9dfe-44cc-9da8-b4f2883c0eee', 'f01594c5-923b-476e-9e0a-4fcd0e99c0c1'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6892d466-5078-4573-a7e4-9bec3637a0a7 tempest-VolumesDeleteCascade-80220957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6892d466-5078-4573-a7e4-9bec3637a0a7 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6892d466-5078-4573-a7e4-9bec3637a0a7 tempest-VolumesDeleteCascade-80220957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6892d466-5078-4573-a7e4-9bec3637a0a7 tempest-VolumesDeleteCascade-80220957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6892d466-5078-4573-a7e4-9bec3637a0a7 tempest-VolumesDeleteCascade-80220957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6892d466-5078-4573-a7e4-9bec3637a0a7 tempest-VolumesDeleteCascade-80220957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:22 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:55:22 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Flow 'volume_create_manager' (6a74d234-9a31-4e8a-bdb8-8fbbf3add110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c67484-bd53-430d-b242-fe89cf0575eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:23 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4 1073741824" returned: 0 in 0.814s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c67484-bd53-430d-b242-fe89cf0575eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-290638106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e084a0c-6a99-435d-a989-f22aec9f4b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05bb525016254831a8442431f1d30c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:23Z,use_quota=True,user_id='80afbd7ec80d4166be46e641783a5d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74a6666f-ce6c-465d-810c-745649f2d856),volume_type_id=74a6666f-ce6c-465d-810c-745649f2d856)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac27fda-609c-4ac3-8fda-9c1580f800b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac27fda-609c-4ac3-8fda-9c1580f800b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d10e719-7615-4155-9f77-9577fb5235d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d10e719-7615-4155-9f77-9577fb5235d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e084a0c-6a99-435d-a989-f22aec9f4b06', 'volume_name': 'volume-4e084a0c-6a99-435d-a989-f22aec9f4b06', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec5211c-3fff-41c6-8dda-c02f65eb743d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec5211c-3fff-41c6-8dda-c02f65eb743d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8809f7-b5d1-4c44-a665-c9ba1e23c922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:23 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Volume 4e084a0c-6a99-435d-a989-f22aec9f4b06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e084a0c-6a99-435d-a989-f22aec9f4b06', 'volume_size': 1} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:23 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6892d466-5078-4573-a7e4-9bec3637a0a7 tempest-VolumesDeleteCascade-80220957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.628s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-6892d466-5078-4573-a7e4-9bec3637a0a7 tempest-VolumesDeleteCascade-80220957 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:23 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-6892d466-5078-4573-a7e4-9bec3637a0a7 tempest-VolumesDeleteCascade-80220957 None] Deleted volume successfully. Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6892d466-5078-4573-a7e4-9bec3637a0a7 tempest-VolumesDeleteCascade-80220957 None] Lock "cinder-24f5e7cf-2cd2-46fc-94b9-852a9febc1a0-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:23 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4 Sep 04 15:55:23 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:23 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4" returned: 0 in 0.432s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.515s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-290638106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e084a0c-6a99-435d-a989-f22aec9f4b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05bb525016254831a8442431f1d30c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:23Z,use_quota=True,user_id='80afbd7ec80d4166be46e641783a5d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74a6666f-ce6c-465d-810c-745649f2d856),volume_type_id=74a6666f-ce6c-465d-810c-745649f2d856)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Creating volume 4e084a0c-6a99-435d-a989-f22aec9f4b06 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:55:23 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4e084a0c-6a99-435d-a989-f22aec9f4b06 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc95bef-a402-483f-8aa4-ab07bcb62ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:23 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4e084a0c-6a99-435d-a989-f22aec9f4b06 1073741824 Sep 04 15:55:23 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd3af42-b480-4714-91ca-b55be898d491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:23 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Volume volume-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4 (1a5387d3-6cf4-4444-a48e-3ee1826fd7b4): created successfully Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd3af42-b480-4714-91ca-b55be898d491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Flow 'volume_create_manager' (21e4dbd2-d23e-4d76-8cec-94e374376778) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:23 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-de45d45d-8d7e-441c-9aff-24ccc53a1c0d tempest-TestInstancesWithCinderVolumes-1634677508 None] Created volume successfully. Sep 04 15:55:24 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:55:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Flow 'volume_create_manager' (20e0aac2-ec28-4a2b-a4c0-43a5f9cad88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1cbb4c2-43dc-4418-ab08-415e508dfbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1cbb4c2-43dc-4418-ab08-415e508dfbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-140465994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2caa2cb8-2d50-4286-a46a-1af2c5f31f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05bb525016254831a8442431f1d30c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:24Z,use_quota=True,user_id='80afbd7ec80d4166be46e641783a5d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7121982-dfec-4136-b79f-4986be28882c),volume_type_id=c7121982-dfec-4136-b79f-4986be28882c)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58fa15d7-f893-4219-a2ea-c280155150a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58fa15d7-f893-4219-a2ea-c280155150a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0240b5d6-b106-4f37-8f2f-1d6c00751a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:24 devstack cinder-volume[87513]: DEBUG cinder.image.glance [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Creating Keystone auth plugin from conf {{(pid=87513) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 15:55:24 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4e084a0c-6a99-435d-a989-f22aec9f4b06 1073741824" returned: 0 in 0.893s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4e084a0c-6a99-435d-a989-f22aec9f4b06 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-3b8b039c-013d-4f0a-820d-fb3fb5d9fb85 req-b0eb2745-13c2-4d8d-b359-f854f15eacd7 tempest-ServerActionsTestOtherA-1231278264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:24 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4e084a0c-6a99-435d-a989-f22aec9f4b06 Sep 04 15:55:24 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0240b5d6-b106-4f37-8f2f-1d6c00751a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2caa2cb8-2d50-4286-a46a-1af2c5f31f73', 'volume_name': 'volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73', 'volume_size': 1, 'image_id': '1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1036723748', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '05bb525016254831a8442431f1d30c44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21', 'created_at': datetime.datetime(2026, 9, 4, 13, 55, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 55, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21/file', 'properties': {}}, 'image_service': }' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7f7e5a-16a9-4c7b-b95b-09587005909a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7f7e5a-16a9-4c7b-b95b-09587005909a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58800851-2894-41a7-8a02-a3e51bb23f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:24 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Volume 2caa2cb8-2d50-4286-a46a-1af2c5f31f73: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73', 'volume_size': 1, 'image_id': '1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1036723748', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '05bb525016254831a8442431f1d30c44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21', 'created_at': datetime.datetime(2026, 9, 4, 13, 55, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 55, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21/file', 'properties': {}}, 'image_service': } Sep 04 15:55:24 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Trying to clone 2caa2cb8-2d50-4286-a46a-1af2c5f31f73 from image 1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21', 'metadata': {}}]). {{(pid=87513) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 15:55:25 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4e084a0c-6a99-435d-a989-f22aec9f4b06" returned: 0 in 0.351s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:55:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-3b8b039c-013d-4f0a-820d-fb3fb5d9fb85 req-b0eb2745-13c2-4d8d-b359-f854f15eacd7 tempest-ServerActionsTestOtherA-1231278264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.331s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8809f7-b5d1-4c44-a665-c9ba1e23c922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e084a0c-6a99-435d-a989-f22aec9f4b06', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4492c4-54d3-4f0a-bdd9-1eb6acef1e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:25 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a199b40f-6a36-4af6-9dd8-48eb448d7a1c]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-3b8b039c-013d-4f0a-820d-fb3fb5d9fb85 req-b0eb2745-13c2-4d8d-b359-f854f15eacd7 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:25 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Volume volume-4e084a0c-6a99-435d-a989-f22aec9f4b06 (4e084a0c-6a99-435d-a989-f22aec9f4b06): created successfully Sep 04 15:55:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4492c4-54d3-4f0a-bdd9-1eb6acef1e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Flow 'volume_create_manager' (6a74d234-9a31-4e8a-bdb8-8fbbf3add110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:25 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e5ce5aa1-ada0-4a00-a4d8-661716fe6e39 tempest-TestInstancesWithCinderVolumes-1634677508 None] Created volume successfully. Sep 04 15:55:25 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be Sep 04 15:55:25 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:25 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-3b8b039c-013d-4f0a-820d-fb3fb5d9fb85 req-b0eb2745-13c2-4d8d-b359-f854f15eacd7 tempest-ServerActionsTestOtherA-1231278264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be" returned: 0 in 0.547s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-3b8b039c-013d-4f0a-820d-fb3fb5d9fb85 req-b0eb2745-13c2-4d8d-b359-f854f15eacd7 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:25 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be Sep 04 15:55:25 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:25 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-5e71ac7d-e88b-48b6-917e-bfa3cfae2218 req-e86cb2e5-64ca-44b9-b4c3-2d601d93b964 tempest-AttachVolumeNegativeTest-875161899 None] Terminate volume connection completed successfully. Sep 04 15:55:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-5e71ac7d-e88b-48b6-917e-bfa3cfae2218 req-e86cb2e5-64ca-44b9-b4c3-2d601d93b964 tempest-AttachVolumeNegativeTest-875161899 None] Deleting attachment 1bcd4d09-f856-41c3-8152-cfdd09d80c70. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:55:26 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-3b8b039c-013d-4f0a-820d-fb3fb5d9fb85 req-b0eb2745-13c2-4d8d-b359-f854f15eacd7 tempest-ServerActionsTestOtherA-1231278264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be" returned: 1 in 0.578s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-3b8b039c-013d-4f0a-820d-fb3fb5d9fb85 req-b0eb2745-13c2-4d8d-b359-f854f15eacd7 tempest-ServerActionsTestOtherA-1231278264 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:55:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-3b8b039c-013d-4f0a-820d-fb3fb5d9fb85 req-b0eb2745-13c2-4d8d-b359-f854f15eacd7 tempest-ServerActionsTestOtherA-1231278264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.195s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-3b8b039c-013d-4f0a-820d-fb3fb5d9fb85 req-b0eb2745-13c2-4d8d-b359-f854f15eacd7 tempest-ServerActionsTestOtherA-1231278264 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-a6b6b3bb-4328-42c1-8d1c-6724126706be', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '810f1d81-f1ab-4b72-9d57-6a641f6000fd', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:55:26 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-3b8b039c-013d-4f0a-820d-fb3fb5d9fb85 req-b0eb2745-13c2-4d8d-b359-f854f15eacd7 tempest-ServerActionsTestOtherA-1231278264 None] attachment_update completed successfully. Sep 04 15:55:31 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21_jbgujz9ndevstack@QuobyteHD, size 20.69 MB, duration 6.31 sec {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 15:55:31 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Image download 20.69 MB at 3.28 MB/s Sep 04 15:55:31 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a325c8-829b-4c5a-a39e-090557e0212c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21_jbgujz9ndevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:31 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21_jbgujz9ndevstack@QuobyteHD Sep 04 15:55:31 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:31 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21_jbgujz9ndevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:31 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Temporary image 1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21 is fetched for user 80afbd7ec80d4166be46e641783a5d78. {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 15:55:31 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c42bcb-29bf-4e4e-846a-7b9f2786de05]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21_jbgujz9ndevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:31 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21_jbgujz9ndevstack@QuobyteHD Sep 04 15:55:31 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:32 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-fb48cf10-07c7-4749-8390-46cdcbb55ff5 tempest-ServerActionsTestOtherA-1231278264 None] Terminate volume connection completed successfully. Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-fb48cf10-07c7-4749-8390-46cdcbb55ff5 tempest-ServerActionsTestOtherA-1231278264 None] Deleting attachment 810f1d81-f1ab-4b72-9d57-6a641f6000fd. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Flow 'volume_create_manager' (1793f2b6-1ff5-4c53-9fc1-9640337df764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8448c990-15af-4783-bdac-0ad0ea5876c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:32 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8448c990-15af-4783-bdac-0ad0ea5876c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-75304102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0a5440-1c8f-4189-ae32-4ba10fc03ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7ce7ee46d4479ba9144ddc8cc545b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:32Z,use_quota=True,user_id='7ced9dce5b254e91a4ece6e01ab9f94b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c31e35-aec2-4c50-8f3f-6cb85392663e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c31e35-aec2-4c50-8f3f-6cb85392663e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998266c4-436b-4215-86dd-402e2856f23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998266c4-436b-4215-86dd-402e2856f23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf0a5440-1c8f-4189-ae32-4ba10fc03ec5', 'volume_name': 'volume-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f79881-d1e1-427d-a97c-cb7fa11ea930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f79881-d1e1-427d-a97c-cb7fa11ea930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (468bd2b5-3b05-459d-be8e-73e2175e39d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:32 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Volume bf0a5440-1c8f-4189-ae32-4ba10fc03ec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5', 'volume_size': 1} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-75304102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0a5440-1c8f-4189-ae32-4ba10fc03ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7ce7ee46d4479ba9144ddc8cc545b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:32Z,use_quota=True,user_id='7ced9dce5b254e91a4ece6e01ab9f94b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Creating volume bf0a5440-1c8f-4189-ae32-4ba10fc03ec5 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:55:32 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] Acquiring lock "cinder-a6b6b3bb-4328-42c1-8d1c-6724126706be-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21_jbgujz9ndevstack@QuobyteHD" returned: 0 in 0.691s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:32 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5 1073741824 Sep 04 15:55:32 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] Lock "cinder-a6b6b3bb-4328-42c1-8d1c-6724126706be-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] Acquiring lock "cinder-quobyte-a6b6b3bb-4328-42c1-8d1c-6724126706be" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] Lock "cinder-quobyte-a6b6b3bb-4328-42c1-8d1c-6724126706be" acquired by "delete_volume" :: waited 0.027s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f996fb-50a7-47d1-a4e3-7bd908372c76]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:32 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be Sep 04 15:55:32 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:33 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5 1073741824" returned: 0 in 0.767s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:33 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be" returned: 0 in 0.559s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:33 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5 Sep 04 15:55:33 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:33 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be Sep 04 15:55:33 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:33 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5" returned: 0 in 0.295s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.076s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-140465994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2caa2cb8-2d50-4286-a46a-1af2c5f31f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05bb525016254831a8442431f1d30c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:24Z,use_quota=True,user_id='80afbd7ec80d4166be46e641783a5d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7121982-dfec-4136-b79f-4986be28882c),volume_type_id=c7121982-dfec-4136-b79f-4986be28882c)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Creating volume 2caa2cb8-2d50-4286-a46a-1af2c5f31f73 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:55:33 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:33 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 1073741824 Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (468bd2b5-3b05-459d-be8e-73e2175e39d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:33 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82f7f26-b273-4975-8588-2f228f083dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:33 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Volume volume-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5 (bf0a5440-1c8f-4189-ae32-4ba10fc03ec5): created successfully Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82f7f26-b273-4975-8588-2f228f083dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Flow 'volume_create_manager' (1793f2b6-1ff5-4c53-9fc1-9640337df764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:33 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-34e5881f-1d36-4882-b10b-2d20052c5a11 tempest-VolumesTransfersV357Test-1939723717 None] Created volume successfully. Sep 04 15:55:33 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be" returned: 1 in 0.442s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:33 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be Sep 04 15:55:33 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:33 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a6b6b3bb-4328-42c1-8d1c-6724126706be" returned: 0 in 0.343s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] Lock "cinder-quobyte-a6b6b3bb-4328-42c1-8d1c-6724126706be" released by "delete_volume" :: held 1.448s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:34 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] Acquiring lock "cinder-fa796ff9-0d54-4903-bcd8-085bfc56961e-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 1073741824" returned: 0 in 0.585s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] Lock "cinder-fa796ff9-0d54-4903-bcd8-085bfc56961e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG cinder.quota [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] Created reservations ['4dd8a2cc-9c71-45e0-b51b-3aea59947514', '1555dd10-6e15-4f48-b5fd-387795ecade9', 'de352883-87c8-4887-80e1-ec9cbac9d443', '7026d06d-102d-4c37-b571-61306f6023d7'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:34 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 Sep 04 15:55:34 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] Acquiring lock "cinder-quobyte-fa796ff9-0d54-4903-bcd8-085bfc56961e" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] Lock "cinder-quobyte-fa796ff9-0d54-4903-bcd8-085bfc56961e" acquired by "delete_volume" :: waited 0.051s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65b5a0f-8727-42ac-bd54-5cdae1c8ebd2]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa796ff9-0d54-4903-bcd8-085bfc56961e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:34 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:55:34 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:34 devstack sudo[95521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa796ff9-0d54-4903-bcd8-085bfc56961e Sep 04 15:55:34 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:34 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73" returned: 0 in 0.430s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Attempting download of 1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21 ((None, [{'url': 'file:///opt/stack/data/glance/images/1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21', 'metadata': {}}])) to volume 2caa2cb8-2d50-4286-a46a-1af2c5f31f73. {{(pid=87513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 15:55:34 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.364s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG cinder.manager [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:34 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] Deleted volume successfully. Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-169a451e-724f-4efc-83f2-191bc97a3cc6 req-0eea6575-8798-4a31-b679-285a6f8616f7 tempest-ServerActionsTestOtherA-1231278264 None] Lock "cinder-a6b6b3bb-4328-42c1-8d1c-6724126706be-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c409c26c-4041-4c93-8a31-2f812b02e599]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21_55c94guu {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:34 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa796ff9-0d54-4903-bcd8-085bfc56961e" returned: 0 in 0.585s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa796ff9-0d54-4903-bcd8-085bfc56961e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:34 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:55:34 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21_55c94guu Sep 04 15:55:34 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:34 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:35 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa796ff9-0d54-4903-bcd8-085bfc56961e Sep 04 15:55:35 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:35 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.301s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:55:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 28 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:55:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:55:35 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21_55c94guu" returned: 0 in 0.476s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21_55c94guu {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:35 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e5b0dd4a-f571-47b8-828b-41e50025035c tempest-VolumesTransfersV357Test-1775601876 None] Transfer volume completed successfully. Sep 04 15:55:35 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:35 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21_55c94guu Sep 04 15:55:35 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa796ff9-0d54-4903-bcd8-085bfc56961e" returned: 0 in 0.471s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] Lock "cinder-quobyte-fa796ff9-0d54-4903-bcd8-085bfc56961e" released by "delete_volume" :: held 1.117s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:35 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] Created reservations ['00d1ee45-b5f4-4fd5-b106-0ad0ea5bce9e', '8f1fe651-766b-4a20-92ba-8248c8bdb9bf', '80926814-7a3c-403a-b6ee-712dc8c5ff52', '628b3972-c1bd-4899-9238-624cb53850e5'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:35 devstack cinder-volume[87513]: DEBUG oslo_db.api [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Sep 04 15:55:35 devstack cinder-volume[87513]: [SQL: SELECT reservations.id AS reservations_id, reservations.uuid AS reservations_uuid, reservations.usage_id AS reservations_usage_id, reservations.project_id AS reservations_project_id, reservations.resource AS reservations_resource, reservations.delta AS reservations_delta, reservations.expire AS reservations_expire, reservations.deleted_at AS reservations_deleted_at, reservations.deleted AS reservations_deleted, reservations.created_at AS reservations_created_at, reservations.updated_at AS reservations_updated_at Sep 04 15:55:35 devstack cinder-volume[87513]: FROM reservations Sep 04 15:55:35 devstack cinder-volume[87513]: WHERE reservations.deleted = false AND reservations.uuid IN (%(uuid_1_1)s, %(uuid_1_2)s, %(uuid_1_3)s, %(uuid_1_4)s) FOR UPDATE] Sep 04 15:55:35 devstack cinder-volume[87513]: [parameters: {'uuid_1_1': '00d1ee45-b5f4-4fd5-b106-0ad0ea5bce9e', 'uuid_1_2': '8f1fe651-766b-4a20-92ba-8248c8bdb9bf', 'uuid_1_3': '80926814-7a3c-403a-b6ee-712dc8c5ff52', 'uuid_1_4': '628b3972-c1bd-4899-9238-624cb53850e5'}] Sep 04 15:55:35 devstack cinder-volume[87513]: (Background on this error at: https://sqlalche.me/e/20/e3q8) {{(pid=87513) _is_exception_expected /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:184}} Sep 04 15:55:35 devstack cinder-volume[87513]: DEBUG oslo_db.api [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] Performing DB retry for function cinder.db.api.reservation_commit {{(pid=87513) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:155}} Sep 04 15:55:35 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21_55c94guu" returned: 1 in 0.440s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21_55c94guu' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:55:35 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37fef49-8fb2-45c6-8aa3-d9f14269929f]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21_jbgujz9ndevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:35 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21_jbgujz9ndevstack@QuobyteHD Sep 04 15:55:35 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5491408a-3602-448e-91c3-156a5ceb962a tempest-VolumesTransfersV357Test-1126312302 None] Acquiring lock "cinder-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:36 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5491408a-3602-448e-91c3-156a5ceb962a tempest-VolumesTransfersV357Test-1126312302 None] Lock "cinder-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:36 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5491408a-3602-448e-91c3-156a5ceb962a tempest-VolumesTransfersV357Test-1126312302 None] Acquiring lock "cinder-quobyte-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:36 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5491408a-3602-448e-91c3-156a5ceb962a tempest-VolumesTransfersV357Test-1126312302 None] Lock "cinder-quobyte-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5" acquired by "delete_volume" :: waited 0.014s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:36 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[56992f19-07cd-44aa-986c-7a635c568c35]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5491408a-3602-448e-91c3-156a5ceb962a tempest-VolumesTransfersV357Test-1126312302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:36 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21_jbgujz9ndevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:36 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] 1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21 was qcow2, converting to raw {{(pid=87513) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 15:55:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21_jbgujz9ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:36 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21_jbgujz9ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 Sep 04 15:55:36 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:36 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5 Sep 04 15:55:36 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:36 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5491408a-3602-448e-91c3-156a5ceb962a tempest-VolumesTransfersV357Test-1126312302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5" returned: 0 in 0.431s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5491408a-3602-448e-91c3-156a5ceb962a tempest-VolumesTransfersV357Test-1126312302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:36 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5 Sep 04 15:55:36 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:36 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:55:36 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:55:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:36 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:55:36 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:37 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5491408a-3602-448e-91c3-156a5ceb962a tempest-VolumesTransfersV357Test-1126312302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5" returned: 0 in 0.521s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:37 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5491408a-3602-448e-91c3-156a5ceb962a tempest-VolumesTransfersV357Test-1126312302 None] Lock "cinder-quobyte-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5" released by "delete_volume" :: held 1.051s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:37 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-5491408a-3602-448e-91c3-156a5ceb962a tempest-VolumesTransfersV357Test-1126312302 None] Created reservations ['6d8c66ce-0302-453d-8d0a-b8244a19cfde', '2d6341f0-f116-487b-b8e2-55254c427619', 'b36afbed-c362-4ec0-b73b-97d0ec77538e', 'd9035c61-b34b-4b9e-b76e-f285899fe363'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:37 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.600s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:37 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:37 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] Deleted volume successfully. Sep 04 15:55:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5491408a-3602-448e-91c3-156a5ceb962a tempest-VolumesTransfersV357Test-1126312302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5491408a-3602-448e-91c3-156a5ceb962a tempest-VolumesTransfersV357Test-1126312302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5491408a-3602-448e-91c3-156a5ceb962a tempest-VolumesTransfersV357Test-1126312302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:55:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5491408a-3602-448e-91c3-156a5ceb962a tempest-VolumesTransfersV357Test-1126312302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:55:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5491408a-3602-448e-91c3-156a5ceb962a tempest-VolumesTransfersV357Test-1126312302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5491408a-3602-448e-91c3-156a5ceb962a tempest-VolumesTransfersV357Test-1126312302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:37 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ae940439-c614-4131-bc9f-86b58858ebe1 tempest-ServerActionsTestOtherA-1231278264 None] Lock "cinder-fa796ff9-0d54-4903-bcd8-085bfc56961e-delete_volume" released by "delete_volume" :: held 3.323s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:37 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:55:37 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:37 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5491408a-3602-448e-91c3-156a5ceb962a tempest-VolumesTransfersV357Test-1126312302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.422s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:37 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-5491408a-3602-448e-91c3-156a5ceb962a tempest-VolumesTransfersV357Test-1126312302 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:37 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-5491408a-3602-448e-91c3-156a5ceb962a tempest-VolumesTransfersV357Test-1126312302 None] Deleted volume successfully. Sep 04 15:55:37 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5491408a-3602-448e-91c3-156a5ceb962a tempest-VolumesTransfersV357Test-1126312302 None] Lock "cinder-bf0a5440-1c8f-4189-ae32-4ba10fc03ec5-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:38 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21_jbgujz9ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73" returned: 0 in 2.319s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:38 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21_jbgujz9ndevstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:55:38 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Converted 112.00 MB image at 48.19 MB/s Sep 04 15:55:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:38 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 1G Sep 04 15:55:38 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:38 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 1G" returned: 0 in 0.362s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:38 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd43ea11-1bb3-4c96-b30a-8c967f760c1c]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:39 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 Sep 04 15:55:39 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Flow 'volume_create_manager' (f8ee2500-9a3b-4ccb-bf71-5cdfdab1e9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b55a3d-dd48-4b72-a909-04eaf77d8c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b55a3d-dd48-4b72-a909-04eaf77d8c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-109179490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9bd4df-cbfb-444b-9b2c-b4031f885c54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7ce7ee46d4479ba9144ddc8cc545b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:39Z,use_quota=True,user_id='7ced9dce5b254e91a4ece6e01ab9f94b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e6f9a7-1c51-4189-ad22-6809dc7e4d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e6f9a7-1c51-4189-ad22-6809dc7e4d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97975a2-7e45-4ae3-bd68-626ea09508b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97975a2-7e45-4ae3-bd68-626ea09508b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da9bd4df-cbfb-444b-9b2c-b4031f885c54', 'volume_name': 'volume-da9bd4df-cbfb-444b-9b2c-b4031f885c54', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb79fa69-b900-4d95-85f4-997bfc620e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb79fa69-b900-4d95-85f4-997bfc620e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6670bd-27ee-43a9-a438-4be87438d2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:39 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Volume da9bd4df-cbfb-444b-9b2c-b4031f885c54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da9bd4df-cbfb-444b-9b2c-b4031f885c54', 'volume_size': 1} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-109179490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9bd4df-cbfb-444b-9b2c-b4031f885c54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7ce7ee46d4479ba9144ddc8cc545b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:39Z,use_quota=True,user_id='7ced9dce5b254e91a4ece6e01ab9f94b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Creating volume da9bd4df-cbfb-444b-9b2c-b4031f885c54 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:55:39 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-da9bd4df-cbfb-444b-9b2c-b4031f885c54 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:39 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-da9bd4df-cbfb-444b-9b2c-b4031f885c54 1073741824 Sep 04 15:55:39 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:39 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73" returned: 0 in 0.490s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:39 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 Sep 04 15:55:39 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:39 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-da9bd4df-cbfb-444b-9b2c-b4031f885c54 1073741824" returned: 0 in 0.648s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:39 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73" returned: 1 in 0.568s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Downloaded image 1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21 ((None, [{'url': 'file:///opt/stack/data/glance/images/1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21', 'metadata': {}}])) to volume 2caa2cb8-2d50-4286-a46a-1af2c5f31f73 successfully. {{(pid=87513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Temporary image 1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21 for user 80afbd7ec80d4166be46e641783a5d78 is deleted. {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Marking volume 2caa2cb8-2d50-4286-a46a-1af2c5f31f73 as bootable. {{(pid=87513) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Copying metadata from image 1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21 to 2caa2cb8-2d50-4286-a46a-1af2c5f31f73. {{(pid=87513) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 15:55:39 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Creating volume glance metadata for volume 2caa2cb8-2d50-4286-a46a-1af2c5f31f73 backed by image 1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21 with: {'image_id': '1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21', 'image_name': 'tempest-scenario-img--1036723748', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87513) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 15:55:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-da9bd4df-cbfb-444b-9b2c-b4031f885c54 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:40 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-da9bd4df-cbfb-444b-9b2c-b4031f885c54 Sep 04 15:55:40 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58800851-2894-41a7-8a02-a3e51bb23f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73', 'volume_size': 1, 'image_id': '1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1036723748', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '05bb525016254831a8442431f1d30c44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21', 'created_at': datetime.datetime(2026, 9, 4, 13, 55, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 55, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cc11062-e9c0-4a78-b8f8-5e7f3e30fc21/file', 'properties': {}}, 'image_service': }' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41c43072-fac9-4f62-ace3-def5c7fe4353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:40 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Volume volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 (2caa2cb8-2d50-4286-a46a-1af2c5f31f73): created successfully Sep 04 15:55:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41c43072-fac9-4f62-ace3-def5c7fe4353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Flow 'volume_create_manager' (20e0aac2-ec28-4a2b-a4c0-43a5f9cad88e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:40 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-137c6d81-4ffc-421a-abcb-76f6649f59fc tempest-TestInstancesWithCinderVolumes-1634677508 None] Created volume successfully. Sep 04 15:55:40 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-da9bd4df-cbfb-444b-9b2c-b4031f885c54" returned: 0 in 0.374s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:55:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6670bd-27ee-43a9-a438-4be87438d2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da9bd4df-cbfb-444b-9b2c-b4031f885c54', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96098684-5f6f-49a2-bcd2-b0a360cb0e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:40 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Volume volume-da9bd4df-cbfb-444b-9b2c-b4031f885c54 (da9bd4df-cbfb-444b-9b2c-b4031f885c54): created successfully Sep 04 15:55:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96098684-5f6f-49a2-bcd2-b0a360cb0e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Flow 'volume_create_manager' (f8ee2500-9a3b-4ccb-bf71-5cdfdab1e9c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:40 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-9a5c7a4f-6a90-4efd-a005-513302b1765c tempest-VolumesTransfersV357Test-1939723717 None] Created volume successfully. Sep 04 15:55:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-900c740d-f25d-46d1-b057-c75224838ac7 tempest-VolumesTransfersV357Test-1126312302 None] Acquiring lock "cinder-da9bd4df-cbfb-444b-9b2c-b4031f885c54-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-900c740d-f25d-46d1-b057-c75224838ac7 tempest-VolumesTransfersV357Test-1126312302 None] Lock "cinder-da9bd4df-cbfb-444b-9b2c-b4031f885c54-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-900c740d-f25d-46d1-b057-c75224838ac7 tempest-VolumesTransfersV357Test-1126312302 None] Acquiring lock "cinder-quobyte-da9bd4df-cbfb-444b-9b2c-b4031f885c54" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-900c740d-f25d-46d1-b057-c75224838ac7 tempest-VolumesTransfersV357Test-1126312302 None] Lock "cinder-quobyte-da9bd4df-cbfb-444b-9b2c-b4031f885c54" acquired by "delete_volume" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:41 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1abd48-1ea2-49ef-b651-4d7bb00ca100]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-900c740d-f25d-46d1-b057-c75224838ac7 tempest-VolumesTransfersV357Test-1126312302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-da9bd4df-cbfb-444b-9b2c-b4031f885c54 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:41 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-da9bd4df-cbfb-444b-9b2c-b4031f885c54 Sep 04 15:55:41 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:42 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-900c740d-f25d-46d1-b057-c75224838ac7 tempest-VolumesTransfersV357Test-1126312302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-da9bd4df-cbfb-444b-9b2c-b4031f885c54" returned: 0 in 0.489s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-900c740d-f25d-46d1-b057-c75224838ac7 tempest-VolumesTransfersV357Test-1126312302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-da9bd4df-cbfb-444b-9b2c-b4031f885c54 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:42 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-da9bd4df-cbfb-444b-9b2c-b4031f885c54 Sep 04 15:55:42 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:42 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-900c740d-f25d-46d1-b057-c75224838ac7 tempest-VolumesTransfersV357Test-1126312302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-da9bd4df-cbfb-444b-9b2c-b4031f885c54" returned: 0 in 0.301s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-900c740d-f25d-46d1-b057-c75224838ac7 tempest-VolumesTransfersV357Test-1126312302 None] Lock "cinder-quobyte-da9bd4df-cbfb-444b-9b2c-b4031f885c54" released by "delete_volume" :: held 0.843s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:42 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-900c740d-f25d-46d1-b057-c75224838ac7 tempest-VolumesTransfersV357Test-1126312302 None] Created reservations ['3eae8728-3fea-44ae-a5df-34c929384a66', '08ae8df4-4fa3-45cd-908a-a04b5caf96c1', 'a1b1c071-dd0c-4cab-a0dd-6be9e6f5c209', 'dbca8d8d-be9b-4b5b-9381-9a6af80f1cd8'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-900c740d-f25d-46d1-b057-c75224838ac7 tempest-VolumesTransfersV357Test-1126312302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-900c740d-f25d-46d1-b057-c75224838ac7 tempest-VolumesTransfersV357Test-1126312302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-900c740d-f25d-46d1-b057-c75224838ac7 tempest-VolumesTransfersV357Test-1126312302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:55:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-900c740d-f25d-46d1-b057-c75224838ac7 tempest-VolumesTransfersV357Test-1126312302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:55:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-900c740d-f25d-46d1-b057-c75224838ac7 tempest-VolumesTransfersV357Test-1126312302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-900c740d-f25d-46d1-b057-c75224838ac7 tempest-VolumesTransfersV357Test-1126312302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:42 devstack sudo[95656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:55:42 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:42 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-900c740d-f25d-46d1-b057-c75224838ac7 tempest-VolumesTransfersV357Test-1126312302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.349s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:42 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-900c740d-f25d-46d1-b057-c75224838ac7 tempest-VolumesTransfersV357Test-1126312302 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:42 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-900c740d-f25d-46d1-b057-c75224838ac7 tempest-VolumesTransfersV357Test-1126312302 None] Deleted volume successfully. Sep 04 15:55:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-900c740d-f25d-46d1-b057-c75224838ac7 tempest-VolumesTransfersV357Test-1126312302 None] Lock "cinder-da9bd4df-cbfb-444b-9b2c-b4031f885c54-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-9d7ff799-e461-449c-ae6b-6c7d7d2c002f req-518ededd-973f-471c-bd84-2c94030a9750 tempest-TestInstancesWithCinderVolumes-1634677508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-9d7ff799-e461-449c-ae6b-6c7d7d2c002f req-518ededd-973f-471c-bd84-2c94030a9750 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:46 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f0a96c-8ad3-44fa-9020-155c2ac1c5c9]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-9d7ff799-e461-449c-ae6b-6c7d7d2c002f req-518ededd-973f-471c-bd84-2c94030a9750 tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:46 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 Sep 04 15:55:46 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:47 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-9d7ff799-e461-449c-ae6b-6c7d7d2c002f req-518ededd-973f-471c-bd84-2c94030a9750 tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73" returned: 0 in 0.563s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-9d7ff799-e461-449c-ae6b-6c7d7d2c002f req-518ededd-973f-471c-bd84-2c94030a9750 tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:47 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 Sep 04 15:55:47 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:47 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-9d7ff799-e461-449c-ae6b-6c7d7d2c002f req-518ededd-973f-471c-bd84-2c94030a9750 tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73" returned: 1 in 0.703s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-9d7ff799-e461-449c-ae6b-6c7d7d2c002f req-518ededd-973f-471c-bd84-2c94030a9750 tempest-TestInstancesWithCinderVolumes-1634677508 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:55:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-9d7ff799-e461-449c-ae6b-6c7d7d2c002f req-518ededd-973f-471c-bd84-2c94030a9750 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.352s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-9d7ff799-e461-449c-ae6b-6c7d7d2c002f req-518ededd-973f-471c-bd84-2c94030a9750 tempest-TestInstancesWithCinderVolumes-1634677508 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b43ae21c-a55f-48c2-a6ae-73d29fb78ef7', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:55:48 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-9d7ff799-e461-449c-ae6b-6c7d7d2c002f req-518ededd-973f-471c-bd84-2c94030a9750 tempest-TestInstancesWithCinderVolumes-1634677508 None] attachment_update completed successfully. Sep 04 15:55:56 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:55:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Flow 'volume_create_manager' (11c696d7-4fbc-4ef3-8136-a5d1f998fd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f04284-a235-4f69-8ace-b247183021fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f04284-a235-4f69-8ace-b247183021fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1215651556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469e4335-15de-433a-8bd7-b20ba7448f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655ddd9228ba4e5d8f722387e622edc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:56Z,use_quota=True,user_id='63691ced0bb243dfbcd6e1130f39435d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4d5086-6164-4698-ba8e-c4af7b35ad09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4d5086-6164-4698-ba8e-c4af7b35ad09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d1c918-afa1-4318-8145-e73cc8ad019c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:56 devstack cinder-volume[87513]: DEBUG cinder.image.glance [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Creating Keystone auth plugin from conf {{(pid=87513) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 15:55:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d1c918-afa1-4318-8145-e73cc8ad019c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '469e4335-15de-433a-8bd7-b20ba7448f8b', 'volume_name': 'volume-469e4335-15de-433a-8bd7-b20ba7448f8b', 'volume_size': 1, 'image_id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '32b22b5244654820a43b7715eda03c1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6a8200-9f2a-4b95-95d9-e536d8f9af91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6a8200-9f2a-4b95-95d9-e536d8f9af91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44f489b-29f6-4f66-a25a-10a9448970fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:57 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Volume 469e4335-15de-433a-8bd7-b20ba7448f8b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-469e4335-15de-433a-8bd7-b20ba7448f8b', 'volume_size': 1, 'image_id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '32b22b5244654820a43b7715eda03c1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 15:55:57 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Trying to clone 469e4335-15de-433a-8bd7-b20ba7448f8b from image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}]). {{(pid=87513) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 15:55:57 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_hqtsc5acdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 15:55:57 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Image download 20.69 MB at 20.69 MB/s Sep 04 15:55:58 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f82d87-f97c-45ab-b04a-17c08c3ad416]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_hqtsc5acdevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:58 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_hqtsc5acdevstack@QuobyteHD Sep 04 15:55:58 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:58 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_hqtsc5acdevstack@QuobyteHD" returned: 0 in 0.789s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:58 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Temporary image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 is fetched for user 63691ced0bb243dfbcd6e1130f39435d. {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 15:55:58 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c565f5-3499-4bdd-8ea1-3d0baee38869]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_hqtsc5acdevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:59 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_hqtsc5acdevstack@QuobyteHD Sep 04 15:55:59 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:59 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_hqtsc5acdevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1215651556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469e4335-15de-433a-8bd7-b20ba7448f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655ddd9228ba4e5d8f722387e622edc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:56Z,use_quota=True,user_id='63691ced0bb243dfbcd6e1130f39435d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:55:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Creating volume 469e4335-15de-433a-8bd7-b20ba7448f8b {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:55:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:55:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:55:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:55:59 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:55:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:59 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b 1073741824 Sep 04 15:55:59 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:00 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b 1073741824" returned: 0 in 0.792s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:00 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b Sep 04 15:56:00 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:00 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b" returned: 0 in 0.480s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:00 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:56:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:00 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Attempting download of 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}])) to volume 469e4335-15de-433a-8bd7-b20ba7448f8b. {{(pid=87513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 15:56:00 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace9f584-e93a-4c37-92ed-bf915672d597]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_l52crh3d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:01 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_l52crh3d Sep 04 15:56:01 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:01 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_l52crh3d" returned: 0 in 0.561s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_l52crh3d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:01 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_l52crh3d Sep 04 15:56:01 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:01 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_l52crh3d" returned: 1 in 0.429s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_l52crh3d' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:56:01 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7947af-55d5-4044-8911-ad1c233bdaa3]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_hqtsc5acdevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:02 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_hqtsc5acdevstack@QuobyteHD Sep 04 15:56:02 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:02 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_hqtsc5acdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:02 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 was qcow2, converting to raw {{(pid=87513) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 15:56:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_hqtsc5acdevstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:02 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_hqtsc5acdevstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b Sep 04 15:56:02 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:04 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_hqtsc5acdevstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b" returned: 0 in 2.470s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:04 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_hqtsc5acdevstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:56:04 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Converted 112.00 MB image at 45.32 MB/s Sep 04 15:56:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:04 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b 1G Sep 04 15:56:04 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:05 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b 1G" returned: 0 in 0.508s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:05 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfd4ecb-3c2e-44a9-9639-0fa93ef3d81d]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:05 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b Sep 04 15:56:05 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:05 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b" returned: 0 in 0.603s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:06 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b Sep 04 15:56:06 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:06 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b" returned: 1 in 0.555s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:56:06 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Downloaded image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}])) to volume 469e4335-15de-433a-8bd7-b20ba7448f8b successfully. {{(pid=87513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 15:56:06 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Temporary image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 for user 63691ced0bb243dfbcd6e1130f39435d is deleted. {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 15:56:06 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Marking volume 469e4335-15de-433a-8bd7-b20ba7448f8b as bootable. {{(pid=87513) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 15:56:06 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Copying metadata from image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 to 469e4335-15de-433a-8bd7-b20ba7448f8b. {{(pid=87513) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 15:56:06 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Creating volume glance metadata for volume 469e4335-15de-433a-8bd7-b20ba7448f8b backed by image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87513) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 15:56:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44f489b-29f6-4f66-a25a-10a9448970fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-469e4335-15de-433a-8bd7-b20ba7448f8b', 'volume_size': 1, 'image_id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '32b22b5244654820a43b7715eda03c1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444611ee-d4e9-41ae-8da8-b0368aaad06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:06 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Volume volume-469e4335-15de-433a-8bd7-b20ba7448f8b (469e4335-15de-433a-8bd7-b20ba7448f8b): created successfully Sep 04 15:56:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444611ee-d4e9-41ae-8da8-b0368aaad06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Flow 'volume_create_manager' (11c696d7-4fbc-4ef3-8136-a5d1f998fd60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:06 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-0a5fd345-d2ee-4b58-b280-27bb553b8202 tempest-VolumesExtendTest-795202187 None] Created volume successfully. Sep 04 15:56:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5cc19e30-b188-4e90-88dc-a4573ab89288 tempest-VolumesExtendTest-795202187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5cc19e30-b188-4e90-88dc-a4573ab89288 tempest-VolumesExtendTest-795202187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:07 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b2bb56-b7cf-4962-94f7-608a8f8c1b2b]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5cc19e30-b188-4e90-88dc-a4573ab89288 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:07 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b Sep 04 15:56:07 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:08 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5cc19e30-b188-4e90-88dc-a4573ab89288 tempest-VolumesExtendTest-795202187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b" returned: 0 in 0.557s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5cc19e30-b188-4e90-88dc-a4573ab89288 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:08 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b Sep 04 15:56:08 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:08 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5cc19e30-b188-4e90-88dc-a4573ab89288 tempest-VolumesExtendTest-795202187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b" returned: 1 in 0.611s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5cc19e30-b188-4e90-88dc-a4573ab89288 tempest-VolumesExtendTest-795202187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:56:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5cc19e30-b188-4e90-88dc-a4573ab89288 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b 2G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5cc19e30-b188-4e90-88dc-a4573ab89288 tempest-VolumesExtendTest-795202187 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b 2G" returned: 0 in 0.155s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5cc19e30-b188-4e90-88dc-a4573ab89288 tempest-VolumesExtendTest-795202187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.429s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:09 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-5cc19e30-b188-4e90-88dc-a4573ab89288 tempest-VolumesExtendTest-795202187 None] Extend volume completed successfully. Sep 04 15:56:10 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] Acquiring lock "cinder-469e4335-15de-433a-8bd7-b20ba7448f8b-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:10 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] Lock "cinder-469e4335-15de-433a-8bd7-b20ba7448f8b-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:10 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] Acquiring lock "cinder-quobyte-469e4335-15de-433a-8bd7-b20ba7448f8b" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:10 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] Lock "cinder-quobyte-469e4335-15de-433a-8bd7-b20ba7448f8b" acquired by "delete_volume" :: waited 0.021s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:10 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[813676aa-b460-4085-a677-ad01a1d5cdd2]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:10 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b Sep 04 15:56:10 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:11 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b" returned: 0 in 0.596s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:11 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b Sep 04 15:56:11 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:11 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b" returned: 1 in 0.615s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:56:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:11 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b Sep 04 15:56:11 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:12 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-469e4335-15de-433a-8bd7-b20ba7448f8b" returned: 0 in 0.374s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] Lock "cinder-quobyte-469e4335-15de-433a-8bd7-b20ba7448f8b" released by "delete_volume" :: held 1.704s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] Created reservations ['1720941b-255e-4fd4-b9a7-7dfed7dbb3f1', '741a1e6f-9219-43a9-8a1c-413eae721879', '2326462c-fa1e-4569-8fde-70ce5f1a8a3a', 'dafae42f-efaa-4e3b-b8a6-563609d9d916'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Flow 'volume_create_manager' (d3dda379-98f7-4c32-b70b-a77e2ee15f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956c9b63-99bb-4f13-843b-05ff226611d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956c9b63-99bb-4f13-843b-05ff226611d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-989108558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92e973a-935a-41eb-aa15-e162434adfbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b63badb0c6422982a9cdebcc76218f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:12Z,use_quota=True,user_id='3040dd7451d64788aeea3c511d6b6abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c99f724-a6cb-4fe2-ab69-5accb35efa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c99f724-a6cb-4fe2-ab69-5accb35efa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b9853ef-dfce-4a8b-a5d1-d949635e7ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b9853ef-dfce-4a8b-a5d1-d949635e7ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a92e973a-935a-41eb-aa15-e162434adfbf', 'volume_name': 'volume-a92e973a-935a-41eb-aa15-e162434adfbf', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1feb74a7-e540-4f19-8e88-919f20e0d910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1feb74a7-e540-4f19-8e88-919f20e0d910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8620b126-d00b-4405-bbf8-6400de33c596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:12 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Volume a92e973a-935a-41eb-aa15-e162434adfbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a92e973a-935a-41eb-aa15-e162434adfbf', 'volume_size': 1} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-989108558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92e973a-935a-41eb-aa15-e162434adfbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b63badb0c6422982a9cdebcc76218f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:12Z,use_quota=True,user_id='3040dd7451d64788aeea3c511d6b6abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Creating volume a92e973a-935a-41eb-aa15-e162434adfbf {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:56:12 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a92e973a-935a-41eb-aa15-e162434adfbf 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:12 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a92e973a-935a-41eb-aa15-e162434adfbf 1073741824 Sep 04 15:56:12 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:12 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:56:12 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:12 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.315s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:56:12 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] Deleted volume successfully. Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=83,cinder:SELECT=83,cinder:INSERT=34,cinder:DELETE=5 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:56:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-089230a9-bb8d-4569-abdf-653c04667eba tempest-VolumesExtendTest-795202187 None] Lock "cinder-469e4335-15de-433a-8bd7-b20ba7448f8b-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:13 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a92e973a-935a-41eb-aa15-e162434adfbf 1073741824" returned: 0 in 0.832s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=88,cinder:UPDATE=98,cinder:DELETE=9,cinder:INSERT=26 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a92e973a-935a-41eb-aa15-e162434adfbf {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:13 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a92e973a-935a-41eb-aa15-e162434adfbf Sep 04 15:56:13 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Flow 'volume_create_manager' (1c0234ea-3156-4c23-9fbc-949ebaaa9a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e117c134-b6ea-4b5e-b1c2-c5005ac3a617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e117c134-b6ea-4b5e-b1c2-c5005ac3a617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1198221210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7eb5f12-74d8-47b9-8dd7-a1689ab0022a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655ddd9228ba4e5d8f722387e622edc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:13Z,use_quota=True,user_id='63691ced0bb243dfbcd6e1130f39435d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aecbf7f-bf08-41fc-9e32-50faf520a1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aecbf7f-bf08-41fc-9e32-50faf520a1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:13 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a029a37-5de9-4aa8-97ef-5141dcf2eb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a029a37-5de9-4aa8-97ef-5141dcf2eb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7eb5f12-74d8-47b9-8dd7-a1689ab0022a', 'volume_name': 'volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f10d474-5c3e-47de-9ba3-faecad19782d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f10d474-5c3e-47de-9ba3-faecad19782d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c755b20d-146e-424d-a9f7-6e13b2de70e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:13 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Volume d7eb5f12-74d8-47b9-8dd7-a1689ab0022a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a', 'volume_size': 1} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a92e973a-935a-41eb-aa15-e162434adfbf" returned: 0 in 0.401s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1198221210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7eb5f12-74d8-47b9-8dd7-a1689ab0022a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655ddd9228ba4e5d8f722387e622edc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:13Z,use_quota=True,user_id='63691ced0bb243dfbcd6e1130f39435d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Creating volume d7eb5f12-74d8-47b9-8dd7-a1689ab0022a {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:56:13 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8620b126-d00b-4405-bbf8-6400de33c596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a92e973a-935a-41eb-aa15-e162434adfbf', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:13 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a 1073741824 Sep 04 15:56:13 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f314977e-ee78-4d5d-a565-a405c4c4aaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:13 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Volume volume-a92e973a-935a-41eb-aa15-e162434adfbf (a92e973a-935a-41eb-aa15-e162434adfbf): created successfully Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f314977e-ee78-4d5d-a565-a405c4c4aaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Flow 'volume_create_manager' (d3dda379-98f7-4c32-b70b-a77e2ee15f35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:13 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-7ae58daa-b2a1-4e1e-bee1-88fe578c6b4d tempest-AttachVolumeNegativeTest-875161899 None] Created volume successfully. Sep 04 15:56:14 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a 1073741824" returned: 0 in 0.510s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:14 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a Sep 04 15:56:14 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:14 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a" returned: 0 in 0.311s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:56:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c755b20d-146e-424d-a9f7-6e13b2de70e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4748e21-b490-47be-8576-22833beef996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:14 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Volume volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a (d7eb5f12-74d8-47b9-8dd7-a1689ab0022a): created successfully Sep 04 15:56:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4748e21-b490-47be-8576-22833beef996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Flow 'volume_create_manager' (1c0234ea-3156-4c23-9fbc-949ebaaa9a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:14 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-7cb465e8-577d-4e79-95ec-3660b3af5fff tempest-VolumesExtendTest-795202187 None] Created volume successfully. Sep 04 15:56:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-76137b7e-f064-450a-9683-777c3c266db6 req-24aabc48-84f1-4f5d-bca5-8cdb17221cdd tempest-AttachVolumeNegativeTest-875161899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-76137b7e-f064-450a-9683-777c3c266db6 req-24aabc48-84f1-4f5d-bca5-8cdb17221cdd tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:15 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[041aea82-1457-4273-bd6c-99d280fa0591]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-76137b7e-f064-450a-9683-777c3c266db6 req-24aabc48-84f1-4f5d-bca5-8cdb17221cdd tempest-AttachVolumeNegativeTest-875161899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a92e973a-935a-41eb-aa15-e162434adfbf {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:15 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a92e973a-935a-41eb-aa15-e162434adfbf Sep 04 15:56:15 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:15 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-76137b7e-f064-450a-9683-777c3c266db6 req-24aabc48-84f1-4f5d-bca5-8cdb17221cdd tempest-AttachVolumeNegativeTest-875161899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a92e973a-935a-41eb-aa15-e162434adfbf" returned: 0 in 0.376s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-76137b7e-f064-450a-9683-777c3c266db6 req-24aabc48-84f1-4f5d-bca5-8cdb17221cdd tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.395s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-76137b7e-f064-450a-9683-777c3c266db6 req-24aabc48-84f1-4f5d-bca5-8cdb17221cdd tempest-AttachVolumeNegativeTest-875161899 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-a92e973a-935a-41eb-aa15-e162434adfbf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60617796-583b-4a6c-9b8d-10964968aeee', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:56:15 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-76137b7e-f064-450a-9683-777c3c266db6 req-24aabc48-84f1-4f5d-bca5-8cdb17221cdd tempest-AttachVolumeNegativeTest-875161899 None] attachment_update completed successfully. Sep 04 15:56:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7828581d-f085-4699-ad17-d7d63e5ce2e0 tempest-VolumesExtendTest-795202187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7828581d-f085-4699-ad17-d7d63e5ce2e0 tempest-VolumesExtendTest-795202187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-7828581d-f085-4699-ad17-d7d63e5ce2e0 tempest-VolumesExtendTest-795202187 None] Creating offline snapshot 1e7740aa-65c5-45f3-b936-08844d397fd8 of volume d7eb5f12-74d8-47b9-8dd7-a1689ab0022a {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:56:15 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f16484-1ab4-410a-b5a1-84af6107da73]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7828581d-f085-4699-ad17-d7d63e5ce2e0 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:16 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a Sep 04 15:56:16 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:16 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7828581d-f085-4699-ad17-d7d63e5ce2e0 tempest-VolumesExtendTest-795202187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a" returned: 0 in 0.444s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7828581d-f085-4699-ad17-d7d63e5ce2e0 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:16 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8 1G Sep 04 15:56:16 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:16 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7828581d-f085-4699-ad17-d7d63e5ce2e0 tempest-VolumesExtendTest-795202187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8 1G" returned: 0 in 0.488s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7828581d-f085-4699-ad17-d7d63e5ce2e0 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:16 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8 Sep 04 15:56:16 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:17 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7828581d-f085-4699-ad17-d7d63e5ce2e0 tempest-VolumesExtendTest-795202187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8" returned: 0 in 0.407s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:17 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-7828581d-f085-4699-ad17-d7d63e5ce2e0 tempest-VolumesExtendTest-795202187 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8 is being set with open permissions: ugo+rw Sep 04 15:56:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7828581d-f085-4699-ad17-d7d63e5ce2e0 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:17 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8 Sep 04 15:56:17 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:17 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7828581d-f085-4699-ad17-d7d63e5ce2e0 tempest-VolumesExtendTest-795202187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8" returned: 0 in 0.313s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7828581d-f085-4699-ad17-d7d63e5ce2e0 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:17 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.info Sep 04 15:56:17 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:17 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7828581d-f085-4699-ad17-d7d63e5ce2e0 tempest-VolumesExtendTest-795202187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.info" returned: 0 in 0.358s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:17 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-7828581d-f085-4699-ad17-d7d63e5ce2e0 tempest-VolumesExtendTest-795202187 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.info is being set with open permissions: ugo+rw Sep 04 15:56:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7828581d-f085-4699-ad17-d7d63e5ce2e0 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:17 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.info Sep 04 15:56:17 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:18 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7828581d-f085-4699-ad17-d7d63e5ce2e0 tempest-VolumesExtendTest-795202187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.info" returned: 0 in 0.308s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7828581d-f085-4699-ad17-d7d63e5ce2e0 tempest-VolumesExtendTest-795202187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.464s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:18 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-7828581d-f085-4699-ad17-d7d63e5ce2e0 tempest-VolumesExtendTest-795202187 None] Create snapshot completed successfully Sep 04 15:56:18 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-1805b5dc-710c-4638-b17c-6115fa93a8fc req-c536d95c-668d-4c33-a487-8394736fa559 tempest-AttachVolumeNegativeTest-875161899 None] Terminate volume connection completed successfully. Sep 04 15:56:18 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-1805b5dc-710c-4638-b17c-6115fa93a8fc req-c536d95c-668d-4c33-a487-8394736fa559 tempest-AttachVolumeNegativeTest-875161899 None] Deleting attachment 60617796-583b-4a6c-9b8d-10964968aeee. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:56:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-359cb670-2c91-42f8-adfa-9a070c1e4a63 tempest-VolumesExtendTest-795202187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-359cb670-2c91-42f8-adfa-9a070c1e4a63 tempest-VolumesExtendTest-795202187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:19 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f62f7de-3790-4a52-87ec-a7c22e5f7037]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-359cb670-2c91-42f8-adfa-9a070c1e4a63 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:19 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a Sep 04 15:56:19 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-359cb670-2c91-42f8-adfa-9a070c1e4a63 tempest-VolumesExtendTest-795202187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a" returned: 0 in 0.565s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:19 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-359cb670-2c91-42f8-adfa-9a070c1e4a63 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8 2G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-359cb670-2c91-42f8-adfa-9a070c1e4a63 tempest-VolumesExtendTest-795202187 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8 2G" returned: 0 in 0.388s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-359cb670-2c91-42f8-adfa-9a070c1e4a63 tempest-VolumesExtendTest-795202187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.116s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:20 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-359cb670-2c91-42f8-adfa-9a070c1e4a63 tempest-VolumesExtendTest-795202187 None] Extend volume completed successfully. Sep 04 15:56:21 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] Acquiring lock "cinder-1e7740aa-65c5-45f3-b936-08844d397fd8-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:21 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] Lock "cinder-1e7740aa-65c5-45f3-b936-08844d397fd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:21 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] Acquiring lock "cinder-quobyte-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:22 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] Lock "cinder-quobyte-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:22 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] Acquiring lock "cinder-quobyte-1e7740aa-65c5-45f3-b936-08844d397fd8" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:22 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] Lock "cinder-quobyte-1e7740aa-65c5-45f3-b936-08844d397fd8" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] Deleting offline snapshot 1e7740aa-65c5-45f3-b936-08844d397fd8 of volume d7eb5f12-74d8-47b9-8dd7-a1689ab0022a {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:56:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] snapshot_file for this snap is: volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:56:22 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[20218fc6-fff6-433e-b10f-b69af4766357]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:22 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8 Sep 04 15:56:22 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:22 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8" returned: 0 in 0.818s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:56:23 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc747bdf-4352-4b39-9e7d-f3b3f66701b6]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:23 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a Sep 04 15:56:23 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:23 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a" returned: 0 in 0.611s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:23 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8 Sep 04 15:56:23 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-02108341-fa8f-4b06-b12a-744daf1ce1e9 req-540bf6c5-fc4e-4c6a-a216-2afa01a50412 tempest-TestInstancesWithCinderVolumes-1634677508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-02108341-fa8f-4b06-b12a-744daf1ce1e9 req-540bf6c5-fc4e-4c6a-a216-2afa01a50412 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:24 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb40343e-5ea9-485b-b945-2052610e27a6]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-02108341-fa8f-4b06-b12a-744daf1ce1e9 req-540bf6c5-fc4e-4c6a-a216-2afa01a50412 tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:24 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8" returned: 0 in 0.898s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:24 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8 Sep 04 15:56:24 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:24 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4 Sep 04 15:56:24 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:25 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a.1e7740aa-65c5-45f3-b936-08844d397fd8" returned: 0 in 0.647s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:25 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-02108341-fa8f-4b06-b12a-744daf1ce1e9 req-540bf6c5-fc4e-4c6a-a216-2afa01a50412 tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4" returned: 0 in 0.761s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-02108341-fa8f-4b06-b12a-744daf1ce1e9 req-540bf6c5-fc4e-4c6a-a216-2afa01a50412 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.794s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] Lock "cinder-quobyte-1e7740aa-65c5-45f3-b936-08844d397fd8" released by "_delete_snapshot" :: held 3.276s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] Lock "cinder-quobyte-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a" released by "delete_snapshot" :: held 3.328s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-02108341-fa8f-4b06-b12a-744daf1ce1e9 req-540bf6c5-fc4e-4c6a-a216-2afa01a50412 tempest-TestInstancesWithCinderVolumes-1634677508 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2cf5c069-dea8-427e-8dc9-8a58c03d26a9', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:56:25 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-02108341-fa8f-4b06-b12a-744daf1ce1e9 req-540bf6c5-fc4e-4c6a-a216-2afa01a50412 tempest-TestInstancesWithCinderVolumes-1634677508 None] attachment_update completed successfully. Sep 04 15:56:25 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] Created reservations ['e6d1c11f-3106-4b3a-9d65-7e1be5a9de19', '4bb969e2-4f40-44ba-9caf-b09fd9ee550b', '632348e5-bc1b-4fb1-a8c2-2864d61d47c8', '32fbc240-5165-46f8-895d-b5eb9450d5da'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:25 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] Delete snapshot completed successfully. Sep 04 15:56:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-52081ff2-b238-4ef1-b2f0-cd4dae18d75b tempest-VolumesExtendTest-795202187 None] Lock "cinder-1e7740aa-65c5-45f3-b936-08844d397fd8-delete_snapshot" released by "delete_snapshot" :: held 3.721s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d1ed4b1b-9b31-425d-a40c-d93d5eda1b06 tempest-VolumesExtendTest-795202187 None] Acquiring lock "cinder-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d1ed4b1b-9b31-425d-a40c-d93d5eda1b06 tempest-VolumesExtendTest-795202187 None] Lock "cinder-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d1ed4b1b-9b31-425d-a40c-d93d5eda1b06 tempest-VolumesExtendTest-795202187 None] Acquiring lock "cinder-quobyte-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d1ed4b1b-9b31-425d-a40c-d93d5eda1b06 tempest-VolumesExtendTest-795202187 None] Lock "cinder-quobyte-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a" acquired by "delete_volume" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:26 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[618c2160-b397-4779-9f7c-790ec226af00]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d1ed4b1b-9b31-425d-a40c-d93d5eda1b06 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:26 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a Sep 04 15:56:26 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:27 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d1ed4b1b-9b31-425d-a40c-d93d5eda1b06 tempest-VolumesExtendTest-795202187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a" returned: 0 in 0.560s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d1ed4b1b-9b31-425d-a40c-d93d5eda1b06 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:27 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a Sep 04 15:56:27 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:27 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d1ed4b1b-9b31-425d-a40c-d93d5eda1b06 tempest-VolumesExtendTest-795202187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a" returned: 0 in 0.527s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d1ed4b1b-9b31-425d-a40c-d93d5eda1b06 tempest-VolumesExtendTest-795202187 None] Lock "cinder-quobyte-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a" released by "delete_volume" :: held 1.205s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-28a71b97-1dcc-45a8-aa8a-c2e1795b30a4 req-f11f759b-a765-44f1-9f1d-da1720559aa1 tempest-TestInstancesWithCinderVolumes-1634677508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-28a71b97-1dcc-45a8-aa8a-c2e1795b30a4 req-f11f759b-a765-44f1-9f1d-da1720559aa1 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:27 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bad13d-bd99-4772-9fbc-af763179bb25]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-28a71b97-1dcc-45a8-aa8a-c2e1795b30a4 req-f11f759b-a765-44f1-9f1d-da1720559aa1 tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4e084a0c-6a99-435d-a989-f22aec9f4b06 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:28 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-d1ed4b1b-9b31-425d-a40c-d93d5eda1b06 tempest-VolumesExtendTest-795202187 None] Created reservations ['51578ec0-d4d9-407a-b69c-66cd2bb8e23a', '5f1d4d5c-d29b-4246-8a0d-d0c0c9c46f6a', 'ca010814-6e04-4743-a6f6-2f2712623217', '400879b4-9638-4dac-9129-a15f5061109a'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d1ed4b1b-9b31-425d-a40c-d93d5eda1b06 tempest-VolumesExtendTest-795202187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d1ed4b1b-9b31-425d-a40c-d93d5eda1b06 tempest-VolumesExtendTest-795202187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed4b1b-9b31-425d-a40c-d93d5eda1b06 tempest-VolumesExtendTest-795202187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:56:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed4b1b-9b31-425d-a40c-d93d5eda1b06 tempest-VolumesExtendTest-795202187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:56:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d1ed4b1b-9b31-425d-a40c-d93d5eda1b06 tempest-VolumesExtendTest-795202187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d1ed4b1b-9b31-425d-a40c-d93d5eda1b06 tempest-VolumesExtendTest-795202187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:28 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4e084a0c-6a99-435d-a989-f22aec9f4b06 Sep 04 15:56:28 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:28 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:56:28 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:28 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-28a71b97-1dcc-45a8-aa8a-c2e1795b30a4 req-f11f759b-a765-44f1-9f1d-da1720559aa1 tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4e084a0c-6a99-435d-a989-f22aec9f4b06" returned: 0 in 0.455s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-28a71b97-1dcc-45a8-aa8a-c2e1795b30a4 req-f11f759b-a765-44f1-9f1d-da1720559aa1 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.476s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:28 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d1ed4b1b-9b31-425d-a40c-d93d5eda1b06 tempest-VolumesExtendTest-795202187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.355s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:28 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-d1ed4b1b-9b31-425d-a40c-d93d5eda1b06 tempest-VolumesExtendTest-795202187 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:56:28 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-d1ed4b1b-9b31-425d-a40c-d93d5eda1b06 tempest-VolumesExtendTest-795202187 None] Deleted volume successfully. Sep 04 15:56:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-28a71b97-1dcc-45a8-aa8a-c2e1795b30a4 req-f11f759b-a765-44f1-9f1d-da1720559aa1 tempest-TestInstancesWithCinderVolumes-1634677508 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-4e084a0c-6a99-435d-a989-f22aec9f4b06', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a166f46-5c4e-4027-9327-8085a03e170d', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:56:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d1ed4b1b-9b31-425d-a40c-d93d5eda1b06 tempest-VolumesExtendTest-795202187 None] Lock "cinder-d7eb5f12-74d8-47b9-8dd7-a1689ab0022a-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:28 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-28a71b97-1dcc-45a8-aa8a-c2e1795b30a4 req-f11f759b-a765-44f1-9f1d-da1720559aa1 tempest-TestInstancesWithCinderVolumes-1634677508 None] attachment_update completed successfully. Sep 04 15:56:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:56:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:56:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:56:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:35 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:56:35 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:35 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-14a7209c-f968-4e02-89b3-b5409c42b6d8 req-ee2541d3-2818-40d3-8448-77eb228bde00 tempest-TestInstancesWithCinderVolumes-1634677508 None] Terminate volume connection completed successfully. Sep 04 15:56:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-14a7209c-f968-4e02-89b3-b5409c42b6d8 req-ee2541d3-2818-40d3-8448-77eb228bde00 tempest-TestInstancesWithCinderVolumes-1634677508 None] Deleting attachment 2cf5c069-dea8-427e-8dc9-8a58c03d26a9. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:56:35 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.544s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:56:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:56:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 28 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:56:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:56:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] Acquiring lock "cinder-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "cinder-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] Acquiring lock "cinder-quobyte-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "cinder-quobyte-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4" acquired by "delete_volume" :: waited 0.023s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:35 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9ead6b-7b40-44a3-a96e-fad79d8f9078]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:36 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4 Sep 04 15:56:36 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:36 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4" returned: 0 in 0.529s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:36 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4 Sep 04 15:56:36 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:36 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4" returned: 0 in 0.395s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:36 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "cinder-quobyte-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4" released by "delete_volume" :: held 0.987s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:36 devstack cinder-volume[87513]: WARNING cinder.quota [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-131473987-1153749096 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-131473987-1153749096, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:56:36 devstack cinder-volume[87513]: WARNING cinder.quota [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-131473987-1153749096 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-131473987-1153749096, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:56:36 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] Created reservations ['1779ccbe-98fa-4b0c-b85c-ac65003f59fe', '5e9940fc-79a6-453a-ab6b-a8b6da30e7af', 'c2e49062-fbb9-4f62-9e65-3b895fcc99a4', '8cea6a3e-7daf-40c5-8f0a-de44184840b6'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:56:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:56:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:37 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:56:37 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:37 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.370s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:37 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:56:37 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] Deleted volume successfully. Sep 04 15:56:37 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d1f5b9e0-5ca5-4f18-a44e-f01883064e45 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "cinder-1a5387d3-6cf4-4444-a48e-3ee1826fd7b4-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:41 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-9106cbb3-2d6a-4209-b7a4-123703d0a03d req-0a13ccee-c825-42f3-862c-3de61b0c7966 tempest-TestInstancesWithCinderVolumes-1634677508 None] Terminate volume connection completed successfully. Sep 04 15:56:41 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-9106cbb3-2d6a-4209-b7a4-123703d0a03d req-0a13ccee-c825-42f3-862c-3de61b0c7966 tempest-TestInstancesWithCinderVolumes-1634677508 None] Deleting attachment 6a166f46-5c4e-4027-9327-8085a03e170d. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:56:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] Acquiring lock "cinder-4e084a0c-6a99-435d-a989-f22aec9f4b06-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "cinder-4e084a0c-6a99-435d-a989-f22aec9f4b06-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] Acquiring lock "cinder-quobyte-4e084a0c-6a99-435d-a989-f22aec9f4b06" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "cinder-quobyte-4e084a0c-6a99-435d-a989-f22aec9f4b06" acquired by "delete_volume" :: waited 0.049s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:41 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[949aff72-02f3-414c-9dfb-4a96a20ac51d]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4e084a0c-6a99-435d-a989-f22aec9f4b06 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:42 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4e084a0c-6a99-435d-a989-f22aec9f4b06 Sep 04 15:56:42 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:42 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4e084a0c-6a99-435d-a989-f22aec9f4b06" returned: 0 in 0.648s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4e084a0c-6a99-435d-a989-f22aec9f4b06 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:42 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4e084a0c-6a99-435d-a989-f22aec9f4b06 Sep 04 15:56:42 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:43 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4e084a0c-6a99-435d-a989-f22aec9f4b06" returned: 0 in 0.503s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "cinder-quobyte-4e084a0c-6a99-435d-a989-f22aec9f4b06" released by "delete_volume" :: held 1.253s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:43 devstack cinder-volume[87513]: WARNING cinder.quota [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1696705424-1306639839 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1696705424-1306639839, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:56:43 devstack cinder-volume[87513]: WARNING cinder.quota [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1696705424-1306639839 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1696705424-1306639839, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:56:43 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] Created reservations ['021b788b-260f-4fcb-a8ef-0caa347ad959', '2e91c7cc-8caa-42b5-bb9b-f83874286ad8', '999a3670-24c4-438d-b00d-4d1e6e660b25', 'e7211c34-93a0-4d73-b320-d1ef0ed6f0ce'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:56:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:56:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:43 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:56:43 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:43 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.324s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:43 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:56:43 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] Deleted volume successfully. Sep 04 15:56:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2e6e3ad2-af61-45f8-9728-f37bf9c920f4 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "cinder-4e084a0c-6a99-435d-a989-f22aec9f4b06-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:49 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:56:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Flow 'volume_create_manager' (e852544b-a31a-4e8d-93ea-1040fef515be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2dbee5-da58-4524-9795-fb786fc99ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2dbee5-da58-4524-9795-fb786fc99ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-887529656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46ffd5ef9c2478d96d40f41d79dad6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:50Z,use_quota=True,user_id='479bc464084d447bbd47e4f7a5dd9219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c878cdb-cecf-4b74-b051-9a06b0e357d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c878cdb-cecf-4b74-b051-9a06b0e357d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6630ab28-f306-4416-9eca-3cdcb55bdfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6630ab28-f306-4416-9eca-3cdcb55bdfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e', 'volume_name': 'volume-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da22c23d-87a4-44a2-97a5-6ab3dd0c37bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da22c23d-87a4-44a2-97a5-6ab3dd0c37bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567b6546-d2e2-4646-9b63-6e4a4e2bd1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:50 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Volume c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e', 'volume_size': 1} Sep 04 15:56:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-887529656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46ffd5ef9c2478d96d40f41d79dad6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:50Z,use_quota=True,user_id='479bc464084d447bbd47e4f7a5dd9219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:56:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Creating volume c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:56:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:56:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:56:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:56:50 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:56:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:50 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e 1073741824 Sep 04 15:56:50 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:50 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e 1073741824" returned: 0 in 0.760s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:50 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e Sep 04 15:56:50 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:51 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e" returned: 0 in 0.441s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:56:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567b6546-d2e2-4646-9b63-6e4a4e2bd1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c346bba6-f826-4730-b967-ddba159d1721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:51 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Volume volume-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e (c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e): created successfully Sep 04 15:56:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c346bba6-f826-4730-b967-ddba159d1721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Flow 'volume_create_manager' (e852544b-a31a-4e8d-93ea-1040fef515be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:51 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ec3112bc-09f3-4a3a-a83a-dc011ff13417 tempest-AttachVolumeTestJSON-1615952070 None] Created volume successfully. Sep 04 15:56:52 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-045e2b2a-c3d8-4811-ba75-46a7714c25d4 req-8bede27c-9632-465f-a20a-ad0f5abd8b71 tempest-TestInstancesWithCinderVolumes-1634677508 None] Terminate volume connection completed successfully. Sep 04 15:56:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-045e2b2a-c3d8-4811-ba75-46a7714c25d4 req-8bede27c-9632-465f-a20a-ad0f5abd8b71 tempest-TestInstancesWithCinderVolumes-1634677508 None] Deleting attachment b43ae21c-a55f-48c2-a6ae-73d29fb78ef7. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:56:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-5da30698-c56f-42fd-b19e-8b76a48104ee req-c2d8f618-7fcb-4146-bca7-3752ae1965b9 tempest-AttachVolumeTestJSON-1615952070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-5da30698-c56f-42fd-b19e-8b76a48104ee req-c2d8f618-7fcb-4146-bca7-3752ae1965b9 tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:53 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fac22a-2eb0-4662-bfd1-be36bac95d3d]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-5da30698-c56f-42fd-b19e-8b76a48104ee req-c2d8f618-7fcb-4146-bca7-3752ae1965b9 tempest-AttachVolumeTestJSON-1615952070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:53 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e Sep 04 15:56:53 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:54 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-5da30698-c56f-42fd-b19e-8b76a48104ee req-c2d8f618-7fcb-4146-bca7-3752ae1965b9 tempest-AttachVolumeTestJSON-1615952070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e" returned: 0 in 0.495s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-5da30698-c56f-42fd-b19e-8b76a48104ee req-c2d8f618-7fcb-4146-bca7-3752ae1965b9 tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.525s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-5da30698-c56f-42fd-b19e-8b76a48104ee req-c2d8f618-7fcb-4146-bca7-3752ae1965b9 tempest-AttachVolumeTestJSON-1615952070 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52de6f66-82b0-4a64-9363-2425da6fbdaf', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:56:54 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-5da30698-c56f-42fd-b19e-8b76a48104ee req-c2d8f618-7fcb-4146-bca7-3752ae1965b9 tempest-AttachVolumeTestJSON-1615952070 None] attachment_update completed successfully. Sep 04 15:56:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] Acquiring lock "cinder-2caa2cb8-2d50-4286-a46a-1af2c5f31f73-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "cinder-2caa2cb8-2d50-4286-a46a-1af2c5f31f73-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] Acquiring lock "cinder-quobyte-2caa2cb8-2d50-4286-a46a-1af2c5f31f73" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "cinder-quobyte-2caa2cb8-2d50-4286-a46a-1af2c5f31f73" acquired by "delete_volume" :: waited 0.037s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:54 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[89eafb18-9d42-4a91-8849-de3b51d7ca88]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:55 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 Sep 04 15:56:55 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:55 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73" returned: 0 in 0.429s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:55 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 Sep 04 15:56:55 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:55 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73" returned: 1 in 0.359s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:56:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:55 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73 Sep 04 15:56:55 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:55 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2caa2cb8-2d50-4286-a46a-1af2c5f31f73" returned: 0 in 0.265s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "cinder-quobyte-2caa2cb8-2d50-4286-a46a-1af2c5f31f73" released by "delete_volume" :: held 1.180s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:55 devstack cinder-volume[87513]: WARNING cinder.quota [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1057697635-2120937139 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1057697635-2120937139, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:56:55 devstack cinder-volume[87513]: WARNING cinder.quota [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1057697635-2120937139 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1057697635-2120937139, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:56:55 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] Created reservations ['eb4c60bb-4552-468f-bc4c-9b6c5971c64f', '54752d77-5e7b-4384-9d54-978d621b5a51', '648c0bcc-2a69-4618-8d32-2c18472d6a93', '8392c1f7-3ba6-4699-a522-3758feee29ff'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:56:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:56:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:56 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:56:56 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:56 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.286s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:56 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:56:56 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] Deleted volume successfully. Sep 04 15:56:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c103a0f3-7e73-4382-b760-8258d58095b8 tempest-TestInstancesWithCinderVolumes-1634677508 None] Lock "cinder-2caa2cb8-2d50-4286-a46a-1af2c5f31f73-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Flow 'volume_create_manager' (69388ad8-af44-43d6-a9f1-6855360c6d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a46e7210-4833-418c-8f62-12ab802b5701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a46e7210-4833-418c-8f62-12ab802b5701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-443182059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1282b8d0-bd54-4859-b5ec-187a705cf796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b63badb0c6422982a9cdebcc76218f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:06Z,use_quota=True,user_id='3040dd7451d64788aeea3c511d6b6abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1cbac2-09ad-497c-9837-2fff5e7fcf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1cbac2-09ad-497c-9837-2fff5e7fcf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebdab47-cc4c-408a-a12a-853b72e81dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebdab47-cc4c-408a-a12a-853b72e81dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1282b8d0-bd54-4859-b5ec-187a705cf796', 'volume_name': 'volume-1282b8d0-bd54-4859-b5ec-187a705cf796', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d719c936-7de5-4989-b282-1a760f184822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d719c936-7de5-4989-b282-1a760f184822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0881b74-d692-4a4c-8605-cfc505c068eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:05 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Volume 1282b8d0-bd54-4859-b5ec-187a705cf796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1282b8d0-bd54-4859-b5ec-187a705cf796', 'volume_size': 1} Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-443182059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1282b8d0-bd54-4859-b5ec-187a705cf796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b63badb0c6422982a9cdebcc76218f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:06Z,use_quota=True,user_id='3040dd7451d64788aeea3c511d6b6abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Creating volume 1282b8d0-bd54-4859-b5ec-187a705cf796 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:57:05 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:57:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1282b8d0-bd54-4859-b5ec-187a705cf796 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:05 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1282b8d0-bd54-4859-b5ec-187a705cf796 1073741824 Sep 04 15:57:05 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:06 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1282b8d0-bd54-4859-b5ec-187a705cf796 1073741824" returned: 0 in 0.712s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1282b8d0-bd54-4859-b5ec-187a705cf796 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:06 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1282b8d0-bd54-4859-b5ec-187a705cf796 Sep 04 15:57:06 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:07 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1282b8d0-bd54-4859-b5ec-187a705cf796" returned: 0 in 0.596s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:57:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0881b74-d692-4a4c-8605-cfc505c068eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1282b8d0-bd54-4859-b5ec-187a705cf796', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec4a61de-bb7b-47b6-bf30-076a63d99788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:07 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Volume volume-1282b8d0-bd54-4859-b5ec-187a705cf796 (1282b8d0-bd54-4859-b5ec-187a705cf796): created successfully Sep 04 15:57:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec4a61de-bb7b-47b6-bf30-076a63d99788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Flow 'volume_create_manager' (69388ad8-af44-43d6-a9f1-6855360c6d70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:07 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-06ede304-d400-48ae-b3b9-382d4ca36e84 tempest-AttachVolumeNegativeTest-875161899 None] Created volume successfully. Sep 04 15:57:08 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:57:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Flow 'volume_create_manager' (32a2d4fb-dfb0-4252-a8e8-27012dc3aa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e27e9dda-c90f-40df-9f80-b0e301282b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e27e9dda-c90f-40df-9f80-b0e301282b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1816349778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f3d40a6-d96d-46d1-9978-d2448016a70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badb81943cd0404285f267a56b856dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:09Z,use_quota=True,user_id='1e5cbab276bc4604922deea8a97d7535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c09a98-ed64-478b-a391-d8af3296e766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c09a98-ed64-478b-a391-d8af3296e766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451dd901-94d2-49d4-b394-dfabf4b66b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:08 devstack cinder-volume[87513]: DEBUG cinder.image.glance [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Creating Keystone auth plugin from conf {{(pid=87513) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 15:57:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-0714f326-fafc-44b2-b062-e3b8c8877905 req-4dd9ead1-97b3-42d2-95c0-8c72fc31459f tempest-AttachVolumeNegativeTest-875161899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-0714f326-fafc-44b2-b062-e3b8c8877905 req-4dd9ead1-97b3-42d2-95c0-8c72fc31459f tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:09 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fd1f21-22cc-4b9c-85cc-180c27ff6495]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-0714f326-fafc-44b2-b062-e3b8c8877905 req-4dd9ead1-97b3-42d2-95c0-8c72fc31459f tempest-AttachVolumeNegativeTest-875161899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1282b8d0-bd54-4859-b5ec-187a705cf796 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:09 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1282b8d0-bd54-4859-b5ec-187a705cf796 Sep 04 15:57:09 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451dd901-94d2-49d4-b394-dfabf4b66b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2f3d40a6-d96d-46d1-9978-d2448016a70c', 'volume_name': 'volume-2f3d40a6-d96d-46d1-9978-d2448016a70c', 'volume_size': 1, 'image_id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '32b22b5244654820a43b7715eda03c1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ecc7820-621d-40a1-8d80-afb7665abbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ecc7820-621d-40a1-8d80-afb7665abbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e38cbe-c235-4412-a024-f019b35dd6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:09 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Volume 2f3d40a6-d96d-46d1-9978-d2448016a70c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2f3d40a6-d96d-46d1-9978-d2448016a70c', 'volume_size': 1, 'image_id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '32b22b5244654820a43b7715eda03c1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 15:57:09 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Trying to clone 2f3d40a6-d96d-46d1-9978-d2448016a70c from image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}]). {{(pid=87513) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 15:57:09 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-0714f326-fafc-44b2-b062-e3b8c8877905 req-4dd9ead1-97b3-42d2-95c0-8c72fc31459f tempest-AttachVolumeNegativeTest-875161899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1282b8d0-bd54-4859-b5ec-187a705cf796" returned: 0 in 0.639s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-0714f326-fafc-44b2-b062-e3b8c8877905 req-4dd9ead1-97b3-42d2-95c0-8c72fc31459f tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.666s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-0714f326-fafc-44b2-b062-e3b8c8877905 req-4dd9ead1-97b3-42d2-95c0-8c72fc31459f tempest-AttachVolumeNegativeTest-875161899 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-1282b8d0-bd54-4859-b5ec-187a705cf796', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4765c40-024e-4395-8d7a-44662668e74c', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:57:10 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-0714f326-fafc-44b2-b062-e3b8c8877905 req-4dd9ead1-97b3-42d2-95c0-8c72fc31459f tempest-AttachVolumeNegativeTest-875161899 None] attachment_update completed successfully. Sep 04 15:57:10 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_0o0bt_c9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 15:57:10 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Image download 20.69 MB at 20.69 MB/s Sep 04 15:57:10 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[97689751-24a8-41a5-b9a5-f8666dc87b64]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_0o0bt_c9devstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:10 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_0o0bt_c9devstack@QuobyteHD Sep 04 15:57:10 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:10 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_0o0bt_c9devstack@QuobyteHD" returned: 0 in 0.478s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:10 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Temporary image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 is fetched for user 1e5cbab276bc4604922deea8a97d7535. {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 15:57:10 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5385c43-59db-466b-8249-628d475d75e9]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_0o0bt_c9devstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:10 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_0o0bt_c9devstack@QuobyteHD Sep 04 15:57:10 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:11 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_0o0bt_c9devstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1816349778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f3d40a6-d96d-46d1-9978-d2448016a70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='badb81943cd0404285f267a56b856dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:09Z,use_quota=True,user_id='1e5cbab276bc4604922deea8a97d7535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:57:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Creating volume 2f3d40a6-d96d-46d1-9978-d2448016a70c {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:57:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:57:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:57:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:57:11 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:57:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:11 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c 1073741824 Sep 04 15:57:11 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:11 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c 1073741824" returned: 0 in 0.615s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:11 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c Sep 04 15:57:11 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:12 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-d6c5bee3-f417-4b64-99db-d6311240e769 req-396a62f7-0711-4f2a-af84-6bd56be5eae4 tempest-AttachVolumeNegativeTest-875161899 None] Terminate volume connection completed successfully. Sep 04 15:57:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-d6c5bee3-f417-4b64-99db-d6311240e769 req-396a62f7-0711-4f2a-af84-6bd56be5eae4 tempest-AttachVolumeNegativeTest-875161899 None] Deleting attachment a4765c40-024e-4395-8d7a-44662668e74c. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:57:12 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c" returned: 0 in 0.378s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:57:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:12 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Attempting download of 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}])) to volume 2f3d40a6-d96d-46d1-9978-d2448016a70c. {{(pid=87513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 15:57:12 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[090930b2-aa33-4d97-9337-12d18444a31b]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_a2hf2xrv {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:12 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_a2hf2xrv Sep 04 15:57:12 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:12 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_a2hf2xrv" returned: 0 in 0.335s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_a2hf2xrv {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:12 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_a2hf2xrv Sep 04 15:57:12 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:13 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_a2hf2xrv" returned: 1 in 0.778s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_a2hf2xrv' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:57:13 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f2b50f-b512-4208-be73-b7f56ce81bb2]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_0o0bt_c9devstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:13 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_0o0bt_c9devstack@QuobyteHD Sep 04 15:57:13 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:14 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_0o0bt_c9devstack@QuobyteHD" returned: 0 in 0.621s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:14 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 was qcow2, converting to raw {{(pid=87513) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 15:57:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_0o0bt_c9devstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:14 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_0o0bt_c9devstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c Sep 04 15:57:14 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:16 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_0o0bt_c9devstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c" returned: 0 in 2.137s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:16 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_0o0bt_c9devstack@QuobyteHD, size 112.00 MB, duration 2.14 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:57:16 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Converted 112.00 MB image at 52.37 MB/s Sep 04 15:57:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:16 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c 1G Sep 04 15:57:16 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:16 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c 1G" returned: 0 in 0.420s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:16 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b8c03b-6f46-48de-8e24-d93ab1da684d]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:16 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c Sep 04 15:57:16 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:17 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c" returned: 0 in 0.497s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:17 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c Sep 04 15:57:17 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:17 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c" returned: 1 in 0.441s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:57:17 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Downloaded image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}])) to volume 2f3d40a6-d96d-46d1-9978-d2448016a70c successfully. {{(pid=87513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 15:57:17 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Temporary image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 for user 1e5cbab276bc4604922deea8a97d7535 is deleted. {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 15:57:17 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Marking volume 2f3d40a6-d96d-46d1-9978-d2448016a70c as bootable. {{(pid=87513) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 15:57:17 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=70,cinder:UPDATE=69,cinder:INSERT=14,cinder:DELETE=6 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:57:17 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Copying metadata from image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 to 2f3d40a6-d96d-46d1-9978-d2448016a70c. {{(pid=87513) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 15:57:17 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Creating volume glance metadata for volume 2f3d40a6-d96d-46d1-9978-d2448016a70c backed by image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87513) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 15:57:17 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=58,cinder:SELECT=76,cinder:INSERT=13,cinder:DELETE=3 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:57:17 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e38cbe-c235-4412-a024-f019b35dd6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f3d40a6-d96d-46d1-9978-d2448016a70c', 'volume_size': 1, 'image_id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '32b22b5244654820a43b7715eda03c1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:17 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4cddf3f-08ba-4ae7-9d11-099d6b5d5253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:17 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Volume volume-2f3d40a6-d96d-46d1-9978-d2448016a70c (2f3d40a6-d96d-46d1-9978-d2448016a70c): created successfully Sep 04 15:57:17 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4cddf3f-08ba-4ae7-9d11-099d6b5d5253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:17 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Flow 'volume_create_manager' (32a2d4fb-dfb0-4252-a8e8-27012dc3aa0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:17 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-473971f2-7b01-4540-8757-87ddf3c744e1 tempest-TestShelveInstance-1372791885 None] Created volume successfully. Sep 04 15:57:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-50a6dd91-7536-4948-bcc5-989eb08a69e1 tempest-AttachVolumeNegativeTest-875161899 None] Acquiring lock "cinder-1282b8d0-bd54-4859-b5ec-187a705cf796-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:18 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-50a6dd91-7536-4948-bcc5-989eb08a69e1 tempest-AttachVolumeNegativeTest-875161899 None] Lock "cinder-1282b8d0-bd54-4859-b5ec-187a705cf796-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:18 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-50a6dd91-7536-4948-bcc5-989eb08a69e1 tempest-AttachVolumeNegativeTest-875161899 None] Acquiring lock "cinder-quobyte-1282b8d0-bd54-4859-b5ec-187a705cf796" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:18 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-50a6dd91-7536-4948-bcc5-989eb08a69e1 tempest-AttachVolumeNegativeTest-875161899 None] Lock "cinder-quobyte-1282b8d0-bd54-4859-b5ec-187a705cf796" acquired by "delete_volume" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:18 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52b3b6d-ecaf-4a7f-99e9-85cfba27e399]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-50a6dd91-7536-4948-bcc5-989eb08a69e1 tempest-AttachVolumeNegativeTest-875161899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1282b8d0-bd54-4859-b5ec-187a705cf796 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:18 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1282b8d0-bd54-4859-b5ec-187a705cf796 Sep 04 15:57:18 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:18 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-50a6dd91-7536-4948-bcc5-989eb08a69e1 tempest-AttachVolumeNegativeTest-875161899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1282b8d0-bd54-4859-b5ec-187a705cf796" returned: 0 in 0.411s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-50a6dd91-7536-4948-bcc5-989eb08a69e1 tempest-AttachVolumeNegativeTest-875161899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1282b8d0-bd54-4859-b5ec-187a705cf796 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:18 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1282b8d0-bd54-4859-b5ec-187a705cf796 Sep 04 15:57:18 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:18 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-50a6dd91-7536-4948-bcc5-989eb08a69e1 tempest-AttachVolumeNegativeTest-875161899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1282b8d0-bd54-4859-b5ec-187a705cf796" returned: 0 in 0.376s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:18 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-50a6dd91-7536-4948-bcc5-989eb08a69e1 tempest-AttachVolumeNegativeTest-875161899 None] Lock "cinder-quobyte-1282b8d0-bd54-4859-b5ec-187a705cf796" released by "delete_volume" :: held 0.842s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:19 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-50a6dd91-7536-4948-bcc5-989eb08a69e1 tempest-AttachVolumeNegativeTest-875161899 None] Created reservations ['46171883-5d12-44c3-869e-b3d7a126801c', 'c5084c7d-a6a7-47d4-83da-5e22ef7ec678', 'ec075030-7ba7-44f3-80d1-91689086732e', '9d81e8d2-5c4d-4f0d-b058-fc8a854e4e57'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:57:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-50a6dd91-7536-4948-bcc5-989eb08a69e1 tempest-AttachVolumeNegativeTest-875161899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-50a6dd91-7536-4948-bcc5-989eb08a69e1 tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-50a6dd91-7536-4948-bcc5-989eb08a69e1 tempest-AttachVolumeNegativeTest-875161899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:57:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-50a6dd91-7536-4948-bcc5-989eb08a69e1 tempest-AttachVolumeNegativeTest-875161899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:57:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-50a6dd91-7536-4948-bcc5-989eb08a69e1 tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-50a6dd91-7536-4948-bcc5-989eb08a69e1 tempest-AttachVolumeNegativeTest-875161899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:19 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:57:19 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-32535741-7e48-48df-9253-de9fa3301ac6 tempest-AttachVolumeNegativeTest-875161899 None] Acquiring lock "cinder-a92e973a-935a-41eb-aa15-e162434adfbf-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-32535741-7e48-48df-9253-de9fa3301ac6 tempest-AttachVolumeNegativeTest-875161899 None] Lock "cinder-a92e973a-935a-41eb-aa15-e162434adfbf-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-32535741-7e48-48df-9253-de9fa3301ac6 tempest-AttachVolumeNegativeTest-875161899 None] Acquiring lock "cinder-quobyte-a92e973a-935a-41eb-aa15-e162434adfbf" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:19 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-50a6dd91-7536-4948-bcc5-989eb08a69e1 tempest-AttachVolumeNegativeTest-875161899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.379s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:19 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-50a6dd91-7536-4948-bcc5-989eb08a69e1 tempest-AttachVolumeNegativeTest-875161899 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:57:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-32535741-7e48-48df-9253-de9fa3301ac6 tempest-AttachVolumeNegativeTest-875161899 None] Lock "cinder-quobyte-a92e973a-935a-41eb-aa15-e162434adfbf" acquired by "delete_volume" :: waited 0.031s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:19 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-50a6dd91-7536-4948-bcc5-989eb08a69e1 tempest-AttachVolumeNegativeTest-875161899 None] Deleted volume successfully. Sep 04 15:57:19 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dd7e7e-a46f-4995-b2be-7ec1ad86079c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-32535741-7e48-48df-9253-de9fa3301ac6 tempest-AttachVolumeNegativeTest-875161899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a92e973a-935a-41eb-aa15-e162434adfbf {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-50a6dd91-7536-4948-bcc5-989eb08a69e1 tempest-AttachVolumeNegativeTest-875161899 None] Lock "cinder-1282b8d0-bd54-4859-b5ec-187a705cf796-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:19 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a92e973a-935a-41eb-aa15-e162434adfbf Sep 04 15:57:19 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:20 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-32535741-7e48-48df-9253-de9fa3301ac6 tempest-AttachVolumeNegativeTest-875161899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a92e973a-935a-41eb-aa15-e162434adfbf" returned: 0 in 0.476s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-32535741-7e48-48df-9253-de9fa3301ac6 tempest-AttachVolumeNegativeTest-875161899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a92e973a-935a-41eb-aa15-e162434adfbf {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:20 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a92e973a-935a-41eb-aa15-e162434adfbf Sep 04 15:57:20 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:20 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-32535741-7e48-48df-9253-de9fa3301ac6 tempest-AttachVolumeNegativeTest-875161899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a92e973a-935a-41eb-aa15-e162434adfbf" returned: 0 in 0.357s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:20 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-32535741-7e48-48df-9253-de9fa3301ac6 tempest-AttachVolumeNegativeTest-875161899 None] Lock "cinder-quobyte-a92e973a-935a-41eb-aa15-e162434adfbf" released by "delete_volume" :: held 0.901s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:20 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-32535741-7e48-48df-9253-de9fa3301ac6 tempest-AttachVolumeNegativeTest-875161899 None] Created reservations ['1332e676-2384-46f9-8d91-407d0adf0bf0', 'd6eeb2fa-a253-45d0-ba3d-52882abf247b', 'e0d25af8-26b2-4869-8311-e7ae71b7ab20', '31df696b-fbbd-45a6-a833-c43aa6a421fd'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:57:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-32535741-7e48-48df-9253-de9fa3301ac6 tempest-AttachVolumeNegativeTest-875161899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-32535741-7e48-48df-9253-de9fa3301ac6 tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:20 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-32535741-7e48-48df-9253-de9fa3301ac6 tempest-AttachVolumeNegativeTest-875161899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:57:20 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-32535741-7e48-48df-9253-de9fa3301ac6 tempest-AttachVolumeNegativeTest-875161899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:57:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-32535741-7e48-48df-9253-de9fa3301ac6 tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-32535741-7e48-48df-9253-de9fa3301ac6 tempest-AttachVolumeNegativeTest-875161899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:20 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:57:20 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:20 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-32535741-7e48-48df-9253-de9fa3301ac6 tempest-AttachVolumeNegativeTest-875161899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.362s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:20 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-32535741-7e48-48df-9253-de9fa3301ac6 tempest-AttachVolumeNegativeTest-875161899 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:57:20 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-32535741-7e48-48df-9253-de9fa3301ac6 tempest-AttachVolumeNegativeTest-875161899 None] Deleted volume successfully. Sep 04 15:57:21 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3e4b05e6-91e7-42da-9eff-1ddd94ae6013 tempest-AttachVolumeNegativeTest-875161899 None] Acquiring lock "cinder-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:21 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-32535741-7e48-48df-9253-de9fa3301ac6 tempest-AttachVolumeNegativeTest-875161899 None] Lock "cinder-a92e973a-935a-41eb-aa15-e162434adfbf-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:21 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3e4b05e6-91e7-42da-9eff-1ddd94ae6013 tempest-AttachVolumeNegativeTest-875161899 None] Lock "cinder-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:21 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3e4b05e6-91e7-42da-9eff-1ddd94ae6013 tempest-AttachVolumeNegativeTest-875161899 None] Acquiring lock "cinder-quobyte-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:21 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3e4b05e6-91e7-42da-9eff-1ddd94ae6013 tempest-AttachVolumeNegativeTest-875161899 None] Lock "cinder-quobyte-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4" acquired by "delete_volume" :: waited 0.025s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:21 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[24150288-3589-446c-b88b-dbd2643ebf2c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3e4b05e6-91e7-42da-9eff-1ddd94ae6013 tempest-AttachVolumeNegativeTest-875161899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:21 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4 Sep 04 15:57:21 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:21 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3e4b05e6-91e7-42da-9eff-1ddd94ae6013 tempest-AttachVolumeNegativeTest-875161899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4" returned: 0 in 0.526s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3e4b05e6-91e7-42da-9eff-1ddd94ae6013 tempest-AttachVolumeNegativeTest-875161899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:21 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4 Sep 04 15:57:21 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:22 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3e4b05e6-91e7-42da-9eff-1ddd94ae6013 tempest-AttachVolumeNegativeTest-875161899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4" returned: 0 in 0.413s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:22 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3e4b05e6-91e7-42da-9eff-1ddd94ae6013 tempest-AttachVolumeNegativeTest-875161899 None] Lock "cinder-quobyte-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4" released by "delete_volume" :: held 1.010s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:22 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-3e4b05e6-91e7-42da-9eff-1ddd94ae6013 tempest-AttachVolumeNegativeTest-875161899 None] Created reservations ['ea93e2d5-5cbd-499e-b8f7-75fe78bf00a7', 'be8df0d9-cf0f-45d0-a342-896aed1704eb', 'c06fe292-8751-47e2-b4e5-2db3258b5e8a', 'a487ddbd-0140-4ba0-84e9-f1ffdc0004de'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:57:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-93a78b40-439f-4348-899d-9c2c7629d9c2 req-c71dad52-5ab6-400e-9a21-20597fba16e2 tempest-TestShelveInstance-1372791885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-93a78b40-439f-4348-899d-9c2c7629d9c2 req-c71dad52-5ab6-400e-9a21-20597fba16e2 tempest-TestShelveInstance-1372791885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:22 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0c97fa-fc23-4d4c-a712-4a6a805e59ae]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-93a78b40-439f-4348-899d-9c2c7629d9c2 req-c71dad52-5ab6-400e-9a21-20597fba16e2 tempest-TestShelveInstance-1372791885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3e4b05e6-91e7-42da-9eff-1ddd94ae6013 tempest-AttachVolumeNegativeTest-875161899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3e4b05e6-91e7-42da-9eff-1ddd94ae6013 tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3e4b05e6-91e7-42da-9eff-1ddd94ae6013 tempest-AttachVolumeNegativeTest-875161899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:57:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3e4b05e6-91e7-42da-9eff-1ddd94ae6013 tempest-AttachVolumeNegativeTest-875161899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:57:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3e4b05e6-91e7-42da-9eff-1ddd94ae6013 tempest-AttachVolumeNegativeTest-875161899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3e4b05e6-91e7-42da-9eff-1ddd94ae6013 tempest-AttachVolumeNegativeTest-875161899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:22 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:57:22 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:22 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c Sep 04 15:57:22 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:22 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-93a78b40-439f-4348-899d-9c2c7629d9c2 req-c71dad52-5ab6-400e-9a21-20597fba16e2 tempest-TestShelveInstance-1372791885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c" returned: 0 in 0.498s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-93a78b40-439f-4348-899d-9c2c7629d9c2 req-c71dad52-5ab6-400e-9a21-20597fba16e2 tempest-TestShelveInstance-1372791885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:22 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3e4b05e6-91e7-42da-9eff-1ddd94ae6013 tempest-AttachVolumeNegativeTest-875161899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.470s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:22 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-3e4b05e6-91e7-42da-9eff-1ddd94ae6013 tempest-AttachVolumeNegativeTest-875161899 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:57:22 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-3e4b05e6-91e7-42da-9eff-1ddd94ae6013 tempest-AttachVolumeNegativeTest-875161899 None] Deleted volume successfully. Sep 04 15:57:22 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3e4b05e6-91e7-42da-9eff-1ddd94ae6013 tempest-AttachVolumeNegativeTest-875161899 None] Lock "cinder-d567fb51-ee0d-4ee6-bef7-ed52e9bd26d4-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:23 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c Sep 04 15:57:23 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:23 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-93a78b40-439f-4348-899d-9c2c7629d9c2 req-c71dad52-5ab6-400e-9a21-20597fba16e2 tempest-TestShelveInstance-1372791885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c" returned: 1 in 0.451s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-93a78b40-439f-4348-899d-9c2c7629d9c2 req-c71dad52-5ab6-400e-9a21-20597fba16e2 tempest-TestShelveInstance-1372791885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:57:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-93a78b40-439f-4348-899d-9c2c7629d9c2 req-c71dad52-5ab6-400e-9a21-20597fba16e2 tempest-TestShelveInstance-1372791885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.014s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-93a78b40-439f-4348-899d-9c2c7629d9c2 req-c71dad52-5ab6-400e-9a21-20597fba16e2 tempest-TestShelveInstance-1372791885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-2f3d40a6-d96d-46d1-9978-d2448016a70c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '732435af-d530-450a-a996-8378aca4aabf', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:57:23 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-93a78b40-439f-4348-899d-9c2c7629d9c2 req-c71dad52-5ab6-400e-9a21-20597fba16e2 tempest-TestShelveInstance-1372791885 None] attachment_update completed successfully. Sep 04 15:57:33 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=34,cinder:INSERT=17,cinder:DELETE=3,cinder:UPDATE=27 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:57:33 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=27,cinder:SELECT=19,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:57:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:57:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:57:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:57:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:34 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:57:34 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:35 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.481s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:57:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:57:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 28 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:57:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:57:44 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-d9b02fc3-3e00-486d-bb13-1eadd0e3831a req-6c2a8e31-e7f9-4c3a-8254-ebe96f741359 tempest-AttachVolumeTestJSON-1615952070 None] Terminate volume connection completed successfully. Sep 04 15:57:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-d9b02fc3-3e00-486d-bb13-1eadd0e3831a req-6c2a8e31-e7f9-4c3a-8254-ebe96f741359 tempest-AttachVolumeTestJSON-1615952070 None] Deleting attachment 52de6f66-82b0-4a64-9363-2425da6fbdaf. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Flow 'volume_create_manager' (1b4992ea-e37c-4a2d-b2ce-6839ff5ceadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56eebb03-97d3-4b4e-8b27-ef5f7faf9dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56eebb03-97d3-4b4e-8b27-ef5f7faf9dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1499066986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c40f6e8-d043-4de0-80fe-96310fdd8a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b1789a13e84650b1ec09ddbabd99c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:51Z,use_quota=True,user_id='15298e68d26b4934b2e95f87416e0b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb947c4-298e-4b71-b419-27a7ca97b445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb947c4-298e-4b71-b419-27a7ca97b445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e3f3c7-997a-4682-81e0-fd0d6c3ea527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e3f3c7-997a-4682-81e0-fd0d6c3ea527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c40f6e8-d043-4de0-80fe-96310fdd8a8c', 'volume_name': 'volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc5ac72-bb2e-4a71-a4ed-2fa4af3a8f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc5ac72-bb2e-4a71-a4ed-2fa4af3a8f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18757dff-8836-47cf-a297-ebfb667b932b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:51 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Volume 4c40f6e8-d043-4de0-80fe-96310fdd8a8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c', 'volume_size': 1} Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1499066986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c40f6e8-d043-4de0-80fe-96310fdd8a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b1789a13e84650b1ec09ddbabd99c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:51Z,use_quota=True,user_id='15298e68d26b4934b2e95f87416e0b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Creating volume 4c40f6e8-d043-4de0-80fe-96310fdd8a8c {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:57:51 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:57:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:51 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c 1073741824 Sep 04 15:57:51 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:52 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c 1073741824" returned: 0 in 0.603s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:52 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c Sep 04 15:57:52 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:52 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c" returned: 0 in 0.540s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:57:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18757dff-8836-47cf-a297-ebfb667b932b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b83ccd-c7c3-4d7f-983e-8e68e94224b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:52 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Volume volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c (4c40f6e8-d043-4de0-80fe-96310fdd8a8c): created successfully Sep 04 15:57:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b83ccd-c7c3-4d7f-983e-8e68e94224b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Flow 'volume_create_manager' (1b4992ea-e37c-4a2d-b2ce-6839ff5ceadc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:52 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-33676c5c-4e44-49bd-8e77-c84f0226b7dc tempest-TestImageHashVerification-154001623 None] Created volume successfully. Sep 04 15:57:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0ca6f2ff-263b-4f67-8b62-9b4d81bbb15d tempest-TestImageHashVerification-154001623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0ca6f2ff-263b-4f67-8b62-9b4d81bbb15d tempest-TestImageHashVerification-154001623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:54 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1974fa66-9c91-4bb7-94bb-00ac88057502]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0ca6f2ff-263b-4f67-8b62-9b4d81bbb15d tempest-TestImageHashVerification-154001623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:54 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c Sep 04 15:57:54 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:55 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0ca6f2ff-263b-4f67-8b62-9b4d81bbb15d tempest-TestImageHashVerification-154001623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c" returned: 0 in 0.420s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:55 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabdba78-7997-4d44-a987-c2bf50066976]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0ca6f2ff-263b-4f67-8b62-9b4d81bbb15d tempest-TestImageHashVerification-154001623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:55 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c Sep 04 15:57:55 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:55 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0ca6f2ff-263b-4f67-8b62-9b4d81bbb15d tempest-TestImageHashVerification-154001623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c" returned: 0 in 0.411s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0ca6f2ff-263b-4f67-8b62-9b4d81bbb15d tempest-TestImageHashVerification-154001623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c /opt/stack/data/cinder/conversion/4c40f6e8-d043-4de0-80fe-96310fdd8a8c.temp_image.1be2addb-3a8c-4cb3-9be2-0450c4ee0590pzhulxxh.img {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:55 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c /opt/stack/data/cinder/conversion/4c40f6e8-d043-4de0-80fe-96310fdd8a8c.temp_image.1be2addb-3a8c-4cb3-9be2-0450c4ee0590pzhulxxh.img Sep 04 15:57:55 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:02 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0ca6f2ff-263b-4f67-8b62-9b4d81bbb15d tempest-TestImageHashVerification-154001623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c /opt/stack/data/cinder/conversion/4c40f6e8-d043-4de0-80fe-96310fdd8a8c.temp_image.1be2addb-3a8c-4cb3-9be2-0450c4ee0590pzhulxxh.img" returned: 0 in 7.019s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:02 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[508c19fc-07e6-492a-b573-edc173feca03]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0ca6f2ff-263b-4f67-8b62-9b4d81bbb15d tempest-TestImageHashVerification-154001623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:02 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c Sep 04 15:58:02 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:02 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:58:03 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0ca6f2ff-263b-4f67-8b62-9b4d81bbb15d tempest-TestImageHashVerification-154001623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c" returned: 0 in 0.592s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:03 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-0ca6f2ff-263b-4f67-8b62-9b4d81bbb15d tempest-TestImageHashVerification-154001623 None] Image conversion details: src /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c, size 1024.00 MB, duration 7.02 sec, destination /opt/stack/data/cinder/conversion/4c40f6e8-d043-4de0-80fe-96310fdd8a8c.temp_image.1be2addb-3a8c-4cb3-9be2-0450c4ee0590pzhulxxh.img {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:58:03 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-0ca6f2ff-263b-4f67-8b62-9b4d81bbb15d tempest-TestImageHashVerification-154001623 None] Converted 1024.00 MB image at 145.87 MB/s Sep 04 15:58:03 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-0ca6f2ff-263b-4f67-8b62-9b4d81bbb15d tempest-TestImageHashVerification-154001623 None] 1be2addb-3a8c-4cb3-9be2-0450c4ee0590 was raw, no need to convert to raw {{(pid=87513) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 04 15:58:04 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=4,cinder:SELECT=4 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:58:05 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:58:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Flow 'volume_create_manager' (5043ec00-d030-49e5-93d0-355b58df37fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a33741-0e0b-4cf3-8c22-488d25533380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a33741-0e0b-4cf3-8c22-488d25533380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-983255224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420f1914-b32f-4649-9115-95fcac3f7ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73805caaab6d44f9b0ca7ed3994792ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:05Z,use_quota=True,user_id='8ee4c23ae1f24b81903d5e2d3e2bdebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d568aa7-d56c-4919-bbfc-1b07d9714a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d568aa7-d56c-4919-bbfc-1b07d9714a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c188edf2-d686-4c07-bdff-09e88f038d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c188edf2-d686-4c07-bdff-09e88f038d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '420f1914-b32f-4649-9115-95fcac3f7ec7', 'volume_name': 'volume-420f1914-b32f-4649-9115-95fcac3f7ec7', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7dbcf3-885d-41c2-b13f-0f50e9262b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7dbcf3-885d-41c2-b13f-0f50e9262b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4537b92-d64f-462f-a1a5-df1b25371962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:05 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Volume 420f1914-b32f-4649-9115-95fcac3f7ec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-420f1914-b32f-4649-9115-95fcac3f7ec7', 'volume_size': 1} Sep 04 15:58:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:07 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-ca9d5c44-852d-46d4-bf14-c91cc3d64c6b req-d3e3869c-16dd-44d8-bb15-bcbe8a2e3294 tempest-TestShelveInstance-1372791885 None] Terminate volume connection completed successfully. Sep 04 15:58:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-ca9d5c44-852d-46d4-bf14-c91cc3d64c6b req-d3e3869c-16dd-44d8-bb15-bcbe8a2e3294 tempest-TestShelveInstance-1372791885 None] Deleting attachment 732435af-d530-450a-a996-8378aca4aabf. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:58:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-815ee388-30b7-4846-ac48-1b1e0cb3bd3c req-244aa343-f350-4cff-a2c8-bba3dc4920d1 tempest-TestShelveInstance-1372791885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:20 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=5 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:58:20 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=1,cinder:SELECT=3 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:58:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0ca6f2ff-263b-4f67-8b62-9b4d81bbb15d tempest-TestImageHashVerification-154001623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.742s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0ca6f2ff-263b-4f67-8b62-9b4d81bbb15d tempest-TestImageHashVerification-154001623 None] Uploaded volume to glance image-id: 1be2addb-3a8c-4cb3-9be2-0450c4ee0590. {{(pid=87513) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 04 15:58:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.053s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-983255224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420f1914-b32f-4649-9115-95fcac3f7ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73805caaab6d44f9b0ca7ed3994792ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:05Z,use_quota=True,user_id='8ee4c23ae1f24b81903d5e2d3e2bdebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:58:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Creating volume 420f1914-b32f-4649-9115-95fcac3f7ec7 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:58:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:58:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:58:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:58:25 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:58:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:25 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-0ca6f2ff-263b-4f67-8b62-9b4d81bbb15d tempest-TestImageHashVerification-154001623 None] Copy volume to image completed successfully. Sep 04 15:58:25 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7 1073741824 Sep 04 15:58:25 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:25 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7 1073741824" returned: 0 in 0.473s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:25 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7 Sep 04 15:58:25 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:26 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7" returned: 0 in 0.297s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:58:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-815ee388-30b7-4846-ac48-1b1e0cb3bd3c req-244aa343-f350-4cff-a2c8-bba3dc4920d1 tempest-TestShelveInstance-1372791885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.337s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4537b92-d64f-462f-a1a5-df1b25371962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-420f1914-b32f-4649-9115-95fcac3f7ec7', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440c0634-ef63-45ec-837d-a513ded395c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:26 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Volume volume-420f1914-b32f-4649-9115-95fcac3f7ec7 (420f1914-b32f-4649-9115-95fcac3f7ec7): created successfully Sep 04 15:58:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440c0634-ef63-45ec-837d-a513ded395c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Flow 'volume_create_manager' (5043ec00-d030-49e5-93d0-355b58df37fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:26 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[81625eb0-d6b3-4d30-8247-3e47a89b9daa]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-815ee388-30b7-4846-ac48-1b1e0cb3bd3c req-244aa343-f350-4cff-a2c8-bba3dc4920d1 tempest-TestShelveInstance-1372791885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:26 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ceb49952-1c51-4fe3-973f-085d70168eb0 tempest-SnapshotsActionsTest-331879483 None] Created volume successfully. Sep 04 15:58:26 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c Sep 04 15:58:26 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:26 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-815ee388-30b7-4846-ac48-1b1e0cb3bd3c req-244aa343-f350-4cff-a2c8-bba3dc4920d1 tempest-TestShelveInstance-1372791885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c" returned: 0 in 0.669s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-815ee388-30b7-4846-ac48-1b1e0cb3bd3c req-244aa343-f350-4cff-a2c8-bba3dc4920d1 tempest-TestShelveInstance-1372791885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b49e6575-905f-4d93-83fb-ac9f30230165 tempest-SnapshotsActionsTest-331879483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:27 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c Sep 04 15:58:27 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0cbf75ff-a318-43c5-98b4-3e9606f2da99 tempest-TestImageHashVerification-154001623 None] Acquiring lock "cinder-4c40f6e8-d043-4de0-80fe-96310fdd8a8c-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0cbf75ff-a318-43c5-98b4-3e9606f2da99 tempest-TestImageHashVerification-154001623 None] Lock "cinder-4c40f6e8-d043-4de0-80fe-96310fdd8a8c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0cbf75ff-a318-43c5-98b4-3e9606f2da99 tempest-TestImageHashVerification-154001623 None] Acquiring lock "cinder-quobyte-4c40f6e8-d043-4de0-80fe-96310fdd8a8c" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0cbf75ff-a318-43c5-98b4-3e9606f2da99 tempest-TestImageHashVerification-154001623 None] Lock "cinder-quobyte-4c40f6e8-d043-4de0-80fe-96310fdd8a8c" acquired by "delete_volume" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:27 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[effcd14f-00ee-433e-8e47-120259f79cc2]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0cbf75ff-a318-43c5-98b4-3e9606f2da99 tempest-TestImageHashVerification-154001623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:27 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c Sep 04 15:58:27 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:27 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-815ee388-30b7-4846-ac48-1b1e0cb3bd3c req-244aa343-f350-4cff-a2c8-bba3dc4920d1 tempest-TestShelveInstance-1372791885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c" returned: 1 in 0.505s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-815ee388-30b7-4846-ac48-1b1e0cb3bd3c req-244aa343-f350-4cff-a2c8-bba3dc4920d1 tempest-TestShelveInstance-1372791885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:58:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-815ee388-30b7-4846-ac48-1b1e0cb3bd3c req-244aa343-f350-4cff-a2c8-bba3dc4920d1 tempest-TestShelveInstance-1372791885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.243s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b49e6575-905f-4d93-83fb-ac9f30230165 tempest-SnapshotsActionsTest-331879483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.335s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:27 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-b49e6575-905f-4d93-83fb-ac9f30230165 tempest-SnapshotsActionsTest-331879483 None] Creating offline snapshot 497979f4-81af-4670-beab-9a10488ef270 of volume 420f1914-b32f-4649-9115-95fcac3f7ec7 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:58:27 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc8076d-b4b6-4682-bb6f-2c3b689ca3d6]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b49e6575-905f-4d93-83fb-ac9f30230165 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-815ee388-30b7-4846-ac48-1b1e0cb3bd3c req-244aa343-f350-4cff-a2c8-bba3dc4920d1 tempest-TestShelveInstance-1372791885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-2f3d40a6-d96d-46d1-9978-d2448016a70c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cadf431f-0450-456a-8dee-ff42c221a0ee', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:58:27 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7 Sep 04 15:58:27 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:27 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-815ee388-30b7-4846-ac48-1b1e0cb3bd3c req-244aa343-f350-4cff-a2c8-bba3dc4920d1 tempest-TestShelveInstance-1372791885 None] attachment_update completed successfully. Sep 04 15:58:27 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0cbf75ff-a318-43c5-98b4-3e9606f2da99 tempest-TestImageHashVerification-154001623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c" returned: 0 in 0.570s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0cbf75ff-a318-43c5-98b4-3e9606f2da99 tempest-TestImageHashVerification-154001623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:27 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c Sep 04 15:58:27 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:28 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b49e6575-905f-4d93-83fb-ac9f30230165 tempest-SnapshotsActionsTest-331879483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7" returned: 0 in 0.619s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b49e6575-905f-4d93-83fb-ac9f30230165 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:28 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 1G Sep 04 15:58:28 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:28 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0cbf75ff-a318-43c5-98b4-3e9606f2da99 tempest-TestImageHashVerification-154001623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4c40f6e8-d043-4de0-80fe-96310fdd8a8c" returned: 0 in 0.420s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0cbf75ff-a318-43c5-98b4-3e9606f2da99 tempest-TestImageHashVerification-154001623 None] Lock "cinder-quobyte-4c40f6e8-d043-4de0-80fe-96310fdd8a8c" released by "delete_volume" :: held 1.052s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:28 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-0cbf75ff-a318-43c5-98b4-3e9606f2da99 tempest-TestImageHashVerification-154001623 None] Created reservations ['fc36f2be-c5d9-463e-ba59-0bfa7c2f484e', '1af5e844-a15b-4c7c-8f3b-77d4719170b0', '9db09481-12b0-4e73-9adb-99d55e933390', '0eb155cd-de37-4405-8ecd-4761203d9d4e'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0cbf75ff-a318-43c5-98b4-3e9606f2da99 tempest-TestImageHashVerification-154001623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0cbf75ff-a318-43c5-98b4-3e9606f2da99 tempest-TestImageHashVerification-154001623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0cbf75ff-a318-43c5-98b4-3e9606f2da99 tempest-TestImageHashVerification-154001623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:58:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0cbf75ff-a318-43c5-98b4-3e9606f2da99 tempest-TestImageHashVerification-154001623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:58:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0cbf75ff-a318-43c5-98b4-3e9606f2da99 tempest-TestImageHashVerification-154001623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0cbf75ff-a318-43c5-98b4-3e9606f2da99 tempest-TestImageHashVerification-154001623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:28 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:58:28 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:28 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b49e6575-905f-4d93-83fb-ac9f30230165 tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 1G" returned: 0 in 0.624s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b49e6575-905f-4d93-83fb-ac9f30230165 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420f1914-b32f-4649-9115-95fcac3f7ec7 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:28 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420f1914-b32f-4649-9115-95fcac3f7ec7 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 Sep 04 15:58:28 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:28 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0cbf75ff-a318-43c5-98b4-3e9606f2da99 tempest-TestImageHashVerification-154001623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.350s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:28 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-0cbf75ff-a318-43c5-98b4-3e9606f2da99 tempest-TestImageHashVerification-154001623 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:58:28 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-0cbf75ff-a318-43c5-98b4-3e9606f2da99 tempest-TestImageHashVerification-154001623 None] Deleted volume successfully. Sep 04 15:58:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0cbf75ff-a318-43c5-98b4-3e9606f2da99 tempest-TestImageHashVerification-154001623 None] Lock "cinder-4c40f6e8-d043-4de0-80fe-96310fdd8a8c-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:29 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b49e6575-905f-4d93-83fb-ac9f30230165 tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420f1914-b32f-4649-9115-95fcac3f7ec7 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270" returned: 0 in 0.360s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:29 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-b49e6575-905f-4d93-83fb-ac9f30230165 tempest-SnapshotsActionsTest-331879483 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 is being set with open permissions: ugo+rw Sep 04 15:58:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b49e6575-905f-4d93-83fb-ac9f30230165 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:29 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 Sep 04 15:58:29 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:29 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b49e6575-905f-4d93-83fb-ac9f30230165 tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270" returned: 0 in 0.323s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b49e6575-905f-4d93-83fb-ac9f30230165 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:29 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.info Sep 04 15:58:29 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:29 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b49e6575-905f-4d93-83fb-ac9f30230165 tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.info" returned: 0 in 0.270s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:29 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-b49e6575-905f-4d93-83fb-ac9f30230165 tempest-SnapshotsActionsTest-331879483 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.info is being set with open permissions: ugo+rw Sep 04 15:58:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b49e6575-905f-4d93-83fb-ac9f30230165 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:29 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.info Sep 04 15:58:29 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:30 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b49e6575-905f-4d93-83fb-ac9f30230165 tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.info" returned: 0 in 0.332s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b49e6575-905f-4d93-83fb-ac9f30230165 tempest-SnapshotsActionsTest-331879483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.672s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:30 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b49e6575-905f-4d93-83fb-ac9f30230165 tempest-SnapshotsActionsTest-331879483 None] Create snapshot completed successfully Sep 04 15:58:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d78e84de-1d2d-4431-a4ee-ea828f9d3995 tempest-SnapshotsActionsTest-331879483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d78e84de-1d2d-4431-a4ee-ea828f9d3995 tempest-SnapshotsActionsTest-331879483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-d78e84de-1d2d-4431-a4ee-ea828f9d3995 tempest-SnapshotsActionsTest-331879483 None] Creating offline snapshot 92899d16-5b80-4455-ab2f-5afcdfa14639 of volume 420f1914-b32f-4649-9115-95fcac3f7ec7 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:58:31 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18d4d84-0639-4ae6-b68b-954d8ada277c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d78e84de-1d2d-4431-a4ee-ea828f9d3995 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:31 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 Sep 04 15:58:31 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:31 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d78e84de-1d2d-4431-a4ee-ea828f9d3995 tempest-SnapshotsActionsTest-331879483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270" returned: 0 in 0.855s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-d78e84de-1d2d-4431-a4ee-ea828f9d3995 tempest-SnapshotsActionsTest-331879483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420f1914-b32f-4649-9115-95fcac3f7ec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:58:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d78e84de-1d2d-4431-a4ee-ea828f9d3995 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.92899d16-5b80-4455-ab2f-5afcdfa14639 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:31 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.92899d16-5b80-4455-ab2f-5afcdfa14639 1G Sep 04 15:58:31 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:33 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d78e84de-1d2d-4431-a4ee-ea828f9d3995 tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.92899d16-5b80-4455-ab2f-5afcdfa14639 1G" returned: 0 in 1.300s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d78e84de-1d2d-4431-a4ee-ea828f9d3995 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.92899d16-5b80-4455-ab2f-5afcdfa14639 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:33 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.92899d16-5b80-4455-ab2f-5afcdfa14639 Sep 04 15:58:33 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:34 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d78e84de-1d2d-4431-a4ee-ea828f9d3995 tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.92899d16-5b80-4455-ab2f-5afcdfa14639" returned: 0 in 0.955s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:34 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-d78e84de-1d2d-4431-a4ee-ea828f9d3995 tempest-SnapshotsActionsTest-331879483 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.92899d16-5b80-4455-ab2f-5afcdfa14639 is being set with open permissions: ugo+rw Sep 04 15:58:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d78e84de-1d2d-4431-a4ee-ea828f9d3995 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.92899d16-5b80-4455-ab2f-5afcdfa14639 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:34 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.92899d16-5b80-4455-ab2f-5afcdfa14639 Sep 04 15:58:34 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:34 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d78e84de-1d2d-4431-a4ee-ea828f9d3995 tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.92899d16-5b80-4455-ab2f-5afcdfa14639" returned: 0 in 0.482s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d78e84de-1d2d-4431-a4ee-ea828f9d3995 tempest-SnapshotsActionsTest-331879483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.833s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:34 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-d78e84de-1d2d-4431-a4ee-ea828f9d3995 tempest-SnapshotsActionsTest-331879483 None] Create snapshot completed successfully Sep 04 15:58:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:58:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:58:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:58:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:35 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:58:35 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] Acquiring lock "cinder-92899d16-5b80-4455-ab2f-5afcdfa14639-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-92899d16-5b80-4455-ab2f-5afcdfa14639-delete_snapshot" acquired by "delete_snapshot" :: waited 0.076s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] Acquiring lock "cinder-quobyte-420f1914-b32f-4649-9115-95fcac3f7ec7" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:35 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.762s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:58:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-quobyte-420f1914-b32f-4649-9115-95fcac3f7ec7" acquired by "delete_snapshot" :: waited 0.079s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] Acquiring lock "cinder-quobyte-92899d16-5b80-4455-ab2f-5afcdfa14639" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:58:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 28 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:58:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:58:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-quobyte-92899d16-5b80-4455-ab2f-5afcdfa14639" acquired by "_delete_snapshot" :: waited 0.065s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] Deleting offline snapshot 92899d16-5b80-4455-ab2f-5afcdfa14639 of volume 420f1914-b32f-4649-9115-95fcac3f7ec7 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:58:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] snapshot_file for this snap is: volume-420f1914-b32f-4649-9115-95fcac3f7ec7.92899d16-5b80-4455-ab2f-5afcdfa14639 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:58:35 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[68584eff-f564-474c-8d95-67c71018912a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.92899d16-5b80-4455-ab2f-5afcdfa14639 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:36 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.92899d16-5b80-4455-ab2f-5afcdfa14639 Sep 04 15:58:36 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:36 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.92899d16-5b80-4455-ab2f-5afcdfa14639" returned: 0 in 0.582s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:36 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420f1914-b32f-4649-9115-95fcac3f7ec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:58:36 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb4965d-d763-47d6-a140-a5fd39a030de]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:36 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 Sep 04 15:58:36 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:37 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270" returned: 0 in 0.809s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420f1914-b32f-4649-9115-95fcac3f7ec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:58:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.92899d16-5b80-4455-ab2f-5afcdfa14639 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:37 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.92899d16-5b80-4455-ab2f-5afcdfa14639 Sep 04 15:58:37 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:38 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.92899d16-5b80-4455-ab2f-5afcdfa14639" returned: 0 in 0.882s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.92899d16-5b80-4455-ab2f-5afcdfa14639 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:38 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.92899d16-5b80-4455-ab2f-5afcdfa14639 Sep 04 15:58:38 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:38 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.92899d16-5b80-4455-ab2f-5afcdfa14639" returned: 0 in 0.593s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-quobyte-92899d16-5b80-4455-ab2f-5afcdfa14639" released by "_delete_snapshot" :: held 3.101s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-quobyte-420f1914-b32f-4649-9115-95fcac3f7ec7" released by "delete_snapshot" :: held 3.178s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:39 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] Created reservations ['b0e6ad2c-8a6b-404f-982a-00cd5484168c', '14a509ac-d75c-4cce-ae5c-2999c9203f98', 'f7432d3d-473e-4bb9-8261-fd3726a1b4e6', 'ddb84f02-8bbe-4086-adb0-061e2ed25b6d'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:39 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] Delete snapshot completed successfully. Sep 04 15:58:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4cdb191a-6651-47b3-a4d7-9f14f6d865be tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-92899d16-5b80-4455-ab2f-5afcdfa14639-delete_snapshot" released by "delete_snapshot" :: held 3.635s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f7f8e3c5-8cef-4679-aeea-832dc75639b3 tempest-SnapshotsActionsTest-331879483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f7f8e3c5-8cef-4679-aeea-832dc75639b3 tempest-SnapshotsActionsTest-331879483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-f7f8e3c5-8cef-4679-aeea-832dc75639b3 tempest-SnapshotsActionsTest-331879483 None] Creating offline snapshot 69e9a66f-aadb-4558-b54e-a5eb76804ac6 of volume 420f1914-b32f-4649-9115-95fcac3f7ec7 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:58:40 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe36dfa-c466-49dc-9ac9-c42145dff82e]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f7f8e3c5-8cef-4679-aeea-832dc75639b3 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:41 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 Sep 04 15:58:41 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:41 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f7f8e3c5-8cef-4679-aeea-832dc75639b3 tempest-SnapshotsActionsTest-331879483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270" returned: 0 in 0.608s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:41 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-f7f8e3c5-8cef-4679-aeea-832dc75639b3 tempest-SnapshotsActionsTest-331879483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420f1914-b32f-4649-9115-95fcac3f7ec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:58:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f7f8e3c5-8cef-4679-aeea-832dc75639b3 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.69e9a66f-aadb-4558-b54e-a5eb76804ac6 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:41 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.69e9a66f-aadb-4558-b54e-a5eb76804ac6 1G Sep 04 15:58:41 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:42 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f7f8e3c5-8cef-4679-aeea-832dc75639b3 tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.69e9a66f-aadb-4558-b54e-a5eb76804ac6 1G" returned: 0 in 0.624s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f7f8e3c5-8cef-4679-aeea-832dc75639b3 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.69e9a66f-aadb-4558-b54e-a5eb76804ac6 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:42 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.69e9a66f-aadb-4558-b54e-a5eb76804ac6 Sep 04 15:58:42 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:42 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f7f8e3c5-8cef-4679-aeea-832dc75639b3 tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.69e9a66f-aadb-4558-b54e-a5eb76804ac6" returned: 0 in 0.355s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:42 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-f7f8e3c5-8cef-4679-aeea-832dc75639b3 tempest-SnapshotsActionsTest-331879483 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.69e9a66f-aadb-4558-b54e-a5eb76804ac6 is being set with open permissions: ugo+rw Sep 04 15:58:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f7f8e3c5-8cef-4679-aeea-832dc75639b3 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.69e9a66f-aadb-4558-b54e-a5eb76804ac6 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:42 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.69e9a66f-aadb-4558-b54e-a5eb76804ac6 Sep 04 15:58:42 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:42 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f7f8e3c5-8cef-4679-aeea-832dc75639b3 tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.69e9a66f-aadb-4558-b54e-a5eb76804ac6" returned: 0 in 0.514s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f7f8e3c5-8cef-4679-aeea-832dc75639b3 tempest-SnapshotsActionsTest-331879483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.278s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:43 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-f7f8e3c5-8cef-4679-aeea-832dc75639b3 tempest-SnapshotsActionsTest-331879483 None] Create snapshot completed successfully Sep 04 15:58:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] Acquiring lock "cinder-69e9a66f-aadb-4558-b54e-a5eb76804ac6-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-69e9a66f-aadb-4558-b54e-a5eb76804ac6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] Acquiring lock "cinder-quobyte-420f1914-b32f-4649-9115-95fcac3f7ec7" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-quobyte-420f1914-b32f-4649-9115-95fcac3f7ec7" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] Acquiring lock "cinder-quobyte-69e9a66f-aadb-4558-b54e-a5eb76804ac6" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-quobyte-69e9a66f-aadb-4558-b54e-a5eb76804ac6" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] Deleting offline snapshot 69e9a66f-aadb-4558-b54e-a5eb76804ac6 of volume 420f1914-b32f-4649-9115-95fcac3f7ec7 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:58:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] snapshot_file for this snap is: volume-420f1914-b32f-4649-9115-95fcac3f7ec7.69e9a66f-aadb-4558-b54e-a5eb76804ac6 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:58:44 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd5b013-aa2f-4854-9a45-c53149d65d95]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.69e9a66f-aadb-4558-b54e-a5eb76804ac6 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:44 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.69e9a66f-aadb-4558-b54e-a5eb76804ac6 Sep 04 15:58:44 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:44 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.69e9a66f-aadb-4558-b54e-a5eb76804ac6" returned: 0 in 0.524s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420f1914-b32f-4649-9115-95fcac3f7ec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:58:45 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a233ecc-b457-4daf-a559-c320a0344300]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:45 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 Sep 04 15:58:45 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:45 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270" returned: 0 in 0.527s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420f1914-b32f-4649-9115-95fcac3f7ec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:58:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.69e9a66f-aadb-4558-b54e-a5eb76804ac6 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:45 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.69e9a66f-aadb-4558-b54e-a5eb76804ac6 Sep 04 15:58:45 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:46 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.69e9a66f-aadb-4558-b54e-a5eb76804ac6" returned: 0 in 0.470s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.69e9a66f-aadb-4558-b54e-a5eb76804ac6 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:46 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.69e9a66f-aadb-4558-b54e-a5eb76804ac6 Sep 04 15:58:46 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:46 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.69e9a66f-aadb-4558-b54e-a5eb76804ac6" returned: 0 in 0.291s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-quobyte-69e9a66f-aadb-4558-b54e-a5eb76804ac6" released by "_delete_snapshot" :: held 1.973s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-quobyte-420f1914-b32f-4649-9115-95fcac3f7ec7" released by "delete_snapshot" :: held 2.018s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:46 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] Created reservations ['566026ea-228b-4348-a635-cb66f758f069', 'ab71f4d1-4832-4960-954c-aa40810b44b8', '3ec74576-25eb-4af4-9911-5df24d01ed35', '21407b43-ac09-4e0c-ab52-3054237a387c'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:46 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] Delete snapshot completed successfully. Sep 04 15:58:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbcaf5a8-5432-4e3d-acff-165630989de3 tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-69e9a66f-aadb-4558-b54e-a5eb76804ac6-delete_snapshot" released by "delete_snapshot" :: held 2.286s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d6cfa6de-fe4d-4c57-b986-a66a04e372d6 tempest-SnapshotsActionsTest-331879483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d6cfa6de-fe4d-4c57-b986-a66a04e372d6 tempest-SnapshotsActionsTest-331879483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-d6cfa6de-fe4d-4c57-b986-a66a04e372d6 tempest-SnapshotsActionsTest-331879483 None] Creating offline snapshot df2b5418-130f-4e09-b978-083bc7652cdd of volume 420f1914-b32f-4649-9115-95fcac3f7ec7 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:58:48 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[95503125-8e9a-4e0d-ba35-ad84a4a72e45]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d6cfa6de-fe4d-4c57-b986-a66a04e372d6 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:48 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 Sep 04 15:58:48 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:48 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d6cfa6de-fe4d-4c57-b986-a66a04e372d6 tempest-SnapshotsActionsTest-331879483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270" returned: 0 in 0.386s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-d6cfa6de-fe4d-4c57-b986-a66a04e372d6 tempest-SnapshotsActionsTest-331879483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420f1914-b32f-4649-9115-95fcac3f7ec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:58:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d6cfa6de-fe4d-4c57-b986-a66a04e372d6 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.df2b5418-130f-4e09-b978-083bc7652cdd 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:48 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.df2b5418-130f-4e09-b978-083bc7652cdd 1G Sep 04 15:58:48 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:49 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d6cfa6de-fe4d-4c57-b986-a66a04e372d6 tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.df2b5418-130f-4e09-b978-083bc7652cdd 1G" returned: 0 in 0.489s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d6cfa6de-fe4d-4c57-b986-a66a04e372d6 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.df2b5418-130f-4e09-b978-083bc7652cdd {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:49 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.df2b5418-130f-4e09-b978-083bc7652cdd Sep 04 15:58:49 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:49 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d6cfa6de-fe4d-4c57-b986-a66a04e372d6 tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.df2b5418-130f-4e09-b978-083bc7652cdd" returned: 0 in 0.308s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:49 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-d6cfa6de-fe4d-4c57-b986-a66a04e372d6 tempest-SnapshotsActionsTest-331879483 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.df2b5418-130f-4e09-b978-083bc7652cdd is being set with open permissions: ugo+rw Sep 04 15:58:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d6cfa6de-fe4d-4c57-b986-a66a04e372d6 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.df2b5418-130f-4e09-b978-083bc7652cdd {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:49 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.df2b5418-130f-4e09-b978-083bc7652cdd Sep 04 15:58:49 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:49 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d6cfa6de-fe4d-4c57-b986-a66a04e372d6 tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.df2b5418-130f-4e09-b978-083bc7652cdd" returned: 0 in 0.254s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d6cfa6de-fe4d-4c57-b986-a66a04e372d6 tempest-SnapshotsActionsTest-331879483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.563s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:49 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-d6cfa6de-fe4d-4c57-b986-a66a04e372d6 tempest-SnapshotsActionsTest-331879483 None] Create snapshot completed successfully Sep 04 15:58:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] Acquiring lock "cinder-df2b5418-130f-4e09-b978-083bc7652cdd-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-df2b5418-130f-4e09-b978-083bc7652cdd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] Acquiring lock "cinder-quobyte-420f1914-b32f-4649-9115-95fcac3f7ec7" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-quobyte-420f1914-b32f-4649-9115-95fcac3f7ec7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] Acquiring lock "cinder-quobyte-df2b5418-130f-4e09-b978-083bc7652cdd" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-quobyte-df2b5418-130f-4e09-b978-083bc7652cdd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] Deleting offline snapshot df2b5418-130f-4e09-b978-083bc7652cdd of volume 420f1914-b32f-4649-9115-95fcac3f7ec7 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:58:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] snapshot_file for this snap is: volume-420f1914-b32f-4649-9115-95fcac3f7ec7.df2b5418-130f-4e09-b978-083bc7652cdd {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:58:50 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1becab5-54bf-424a-b8b0-9466cc76ebef]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.df2b5418-130f-4e09-b978-083bc7652cdd {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:50 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.df2b5418-130f-4e09-b978-083bc7652cdd Sep 04 15:58:50 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:50 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.df2b5418-130f-4e09-b978-083bc7652cdd" returned: 0 in 0.403s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420f1914-b32f-4649-9115-95fcac3f7ec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:58:50 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[244f5bf7-8d1c-4f1d-916d-bdc07f691bc3]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:50 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 Sep 04 15:58:50 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:51 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270" returned: 0 in 0.404s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420f1914-b32f-4649-9115-95fcac3f7ec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:58:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.df2b5418-130f-4e09-b978-083bc7652cdd {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:51 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.df2b5418-130f-4e09-b978-083bc7652cdd Sep 04 15:58:51 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:51 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.df2b5418-130f-4e09-b978-083bc7652cdd" returned: 0 in 0.512s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.df2b5418-130f-4e09-b978-083bc7652cdd {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:51 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.df2b5418-130f-4e09-b978-083bc7652cdd Sep 04 15:58:51 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:52 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.df2b5418-130f-4e09-b978-083bc7652cdd" returned: 0 in 0.331s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:52 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-quobyte-df2b5418-130f-4e09-b978-083bc7652cdd" released by "_delete_snapshot" :: held 1.761s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:52 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-quobyte-420f1914-b32f-4649-9115-95fcac3f7ec7" released by "delete_snapshot" :: held 1.794s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:52 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] Created reservations ['d1e377bd-dfb0-408b-974c-9e06f2219299', '2cc4a6c6-e3a6-40c5-ac65-d169e7d5de11', '58437ee1-6be7-4812-89ea-4c76e8aadd37', '40aaf930-f23c-454a-b6a1-848b65b41b00'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:52 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] Delete snapshot completed successfully. Sep 04 15:58:52 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d82d8dec-a234-40b5-94a0-c7c2fd5d46ce tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-df2b5418-130f-4e09-b978-083bc7652cdd-delete_snapshot" released by "delete_snapshot" :: held 2.024s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-984344ca-cd49-4dc1-87d7-ff6ec5f53468 tempest-SnapshotsActionsTest-331879483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-984344ca-cd49-4dc1-87d7-ff6ec5f53468 tempest-SnapshotsActionsTest-331879483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-984344ca-cd49-4dc1-87d7-ff6ec5f53468 tempest-SnapshotsActionsTest-331879483 None] Creating offline snapshot e29d2740-076f-47f7-8fad-0f64ba66ea35 of volume 420f1914-b32f-4649-9115-95fcac3f7ec7 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:58:52 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0465c3e5-e59d-4444-99fa-6498ce250baf]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-984344ca-cd49-4dc1-87d7-ff6ec5f53468 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:52 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 Sep 04 15:58:52 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:53 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-984344ca-cd49-4dc1-87d7-ff6ec5f53468 tempest-SnapshotsActionsTest-331879483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270" returned: 0 in 0.372s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:53 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-984344ca-cd49-4dc1-87d7-ff6ec5f53468 tempest-SnapshotsActionsTest-331879483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420f1914-b32f-4649-9115-95fcac3f7ec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:58:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-984344ca-cd49-4dc1-87d7-ff6ec5f53468 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.e29d2740-076f-47f7-8fad-0f64ba66ea35 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:53 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.e29d2740-076f-47f7-8fad-0f64ba66ea35 1G Sep 04 15:58:53 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:53 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-984344ca-cd49-4dc1-87d7-ff6ec5f53468 tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.e29d2740-076f-47f7-8fad-0f64ba66ea35 1G" returned: 0 in 0.460s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-984344ca-cd49-4dc1-87d7-ff6ec5f53468 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.e29d2740-076f-47f7-8fad-0f64ba66ea35 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:53 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.e29d2740-076f-47f7-8fad-0f64ba66ea35 Sep 04 15:58:53 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:53 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:58:53 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Flow 'volume_create_manager' (4f6a8452-8372-45d4-b1da-8ecd84ef480f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:53 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1e46db-43e2-40b8-af24-5704db34342e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:53 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1e46db-43e2-40b8-af24-5704db34342e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208e3eec-e39e-4c36-95ac-5355552542a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ce8b3ace5544309aa702357eef5797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:54Z,use_quota=True,user_id='75eab362d41146528651405cb3954eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9cb28541-73e1-4986-90b4-f9b022f79f56),volume_type_id=9cb28541-73e1-4986-90b4-f9b022f79f56)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:53 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b663ef61-5e5e-4ecb-9e17-43cfa83f19ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:53 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b663ef61-5e5e-4ecb-9e17-43cfa83f19ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:53 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79db5b2a-d582-4161-98d9-cc7562cf9ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:53 devstack cinder-volume[87513]: DEBUG cinder.image.glance [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Creating Keystone auth plugin from conf {{(pid=87513) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 15:58:53 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-984344ca-cd49-4dc1-87d7-ff6ec5f53468 tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.e29d2740-076f-47f7-8fad-0f64ba66ea35" returned: 0 in 0.293s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:53 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-984344ca-cd49-4dc1-87d7-ff6ec5f53468 tempest-SnapshotsActionsTest-331879483 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.e29d2740-076f-47f7-8fad-0f64ba66ea35 is being set with open permissions: ugo+rw Sep 04 15:58:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-984344ca-cd49-4dc1-87d7-ff6ec5f53468 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.e29d2740-076f-47f7-8fad-0f64ba66ea35 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:53 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.e29d2740-076f-47f7-8fad-0f64ba66ea35 Sep 04 15:58:53 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79db5b2a-d582-4161-98d9-cc7562cf9ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '208e3eec-e39e-4c36-95ac-5355552542a3', 'volume_name': 'volume-208e3eec-e39e-4c36-95ac-5355552542a3', 'volume_size': 1, 'image_id': '3fafcfaf-62fa-488a-b1fb-f20894ae5377', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3fafcfaf-62fa-488a-b1fb-f20894ae5377', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd675212661ce8f15c0c2c8d300041519', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '53ce8b3ace5544309aa702357eef5797', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cc64f388cebc1638b677ef624b1c44835f870f69d529c7d4329a419ea26edfc056dd1cec84fbb95ddeb53d29a6b27f2e0098ad8471c7272b86e41540babbd16a', 'id': '3fafcfaf-62fa-488a-b1fb-f20894ae5377', 'created_at': datetime.datetime(2026, 9, 4, 13, 58, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 58, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3fafcfaf-62fa-488a-b1fb-f20894ae5377/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1819282b-2d4d-4cda-a446-6c1b15b39e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1819282b-2d4d-4cda-a446-6c1b15b39e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (883d038c-aed4-4354-b292-6d5760210b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:54 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Volume 208e3eec-e39e-4c36-95ac-5355552542a3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-208e3eec-e39e-4c36-95ac-5355552542a3', 'volume_size': 1, 'image_id': '3fafcfaf-62fa-488a-b1fb-f20894ae5377', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3fafcfaf-62fa-488a-b1fb-f20894ae5377', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd675212661ce8f15c0c2c8d300041519', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '53ce8b3ace5544309aa702357eef5797', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cc64f388cebc1638b677ef624b1c44835f870f69d529c7d4329a419ea26edfc056dd1cec84fbb95ddeb53d29a6b27f2e0098ad8471c7272b86e41540babbd16a', 'id': '3fafcfaf-62fa-488a-b1fb-f20894ae5377', 'created_at': datetime.datetime(2026, 9, 4, 13, 58, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 58, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3fafcfaf-62fa-488a-b1fb-f20894ae5377/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 04 15:58:54 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Trying to clone 208e3eec-e39e-4c36-95ac-5355552542a3 from image 3fafcfaf-62fa-488a-b1fb-f20894ae5377 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3fafcfaf-62fa-488a-b1fb-f20894ae5377', 'metadata': {}}]). {{(pid=87513) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 15:58:54 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-984344ca-cd49-4dc1-87d7-ff6ec5f53468 tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.e29d2740-076f-47f7-8fad-0f64ba66ea35" returned: 0 in 0.260s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-984344ca-cd49-4dc1-87d7-ff6ec5f53468 tempest-SnapshotsActionsTest-331879483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.493s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:54 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 15:58:54 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Image download 0.00 MB at 0.00 MB/s Sep 04 15:58:54 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-984344ca-cd49-4dc1-87d7-ff6ec5f53468 tempest-SnapshotsActionsTest-331879483 None] Create snapshot completed successfully Sep 04 15:58:54 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed381a5-525f-4178-a39e-753a0f482ae3]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:54 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD Sep 04 15:58:54 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:54 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:54 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD Sep 04 15:58:54 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] Acquiring lock "cinder-e29d2740-076f-47f7-8fad-0f64ba66ea35-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-e29d2740-076f-47f7-8fad-0f64ba66ea35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] Acquiring lock "cinder-quobyte-420f1914-b32f-4649-9115-95fcac3f7ec7" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-quobyte-420f1914-b32f-4649-9115-95fcac3f7ec7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] Acquiring lock "cinder-quobyte-e29d2740-076f-47f7-8fad-0f64ba66ea35" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:55 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD" returned: 1 in 0.394s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Temporary image 3fafcfaf-62fa-488a-b1fb-f20894ae5377 is fetched for user 75eab362d41146528651405cb3954eff. {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-quobyte-e29d2740-076f-47f7-8fad-0f64ba66ea35" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] Deleting offline snapshot e29d2740-076f-47f7-8fad-0f64ba66ea35 of volume 420f1914-b32f-4649-9115-95fcac3f7ec7 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] snapshot_file for this snap is: volume-420f1914-b32f-4649-9115-95fcac3f7ec7.e29d2740-076f-47f7-8fad-0f64ba66ea35 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[099aa7cb-31a4-444b-aad0-2a82305b271a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.e29d2740-076f-47f7-8fad-0f64ba66ea35 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34ed8f0-9beb-43be-a70c-34aa11e9946b]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:55 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.e29d2740-076f-47f7-8fad-0f64ba66ea35 Sep 04 15:58:55 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:55 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD Sep 04 15:58:55 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:55 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.e29d2740-076f-47f7-8fad-0f64ba66ea35" returned: 0 in 0.365s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420f1914-b32f-4649-9115-95fcac3f7ec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4c3502-6846-4be2-b06e-68e53ef8021f]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:55 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:55 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 Sep 04 15:58:55 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:55 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD Sep 04 15:58:55 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:55 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD" returned: 1 in 0.385s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208e3eec-e39e-4c36-95ac-5355552542a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ce8b3ace5544309aa702357eef5797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:54Z,use_quota=True,user_id='75eab362d41146528651405cb3954eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9cb28541-73e1-4986-90b4-f9b022f79f56),volume_type_id=9cb28541-73e1-4986-90b4-f9b022f79f56)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Creating volume 208e3eec-e39e-4c36-95ac-5355552542a3 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:58:55 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:55 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270" returned: 0 in 0.426s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420f1914-b32f-4649-9115-95fcac3f7ec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:58:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.e29d2740-076f-47f7-8fad-0f64ba66ea35 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:55 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3 1073741824 Sep 04 15:58:55 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:55 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.e29d2740-076f-47f7-8fad-0f64ba66ea35 Sep 04 15:58:55 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:56 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.e29d2740-076f-47f7-8fad-0f64ba66ea35" returned: 0 in 0.392s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.e29d2740-076f-47f7-8fad-0f64ba66ea35 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:56 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.e29d2740-076f-47f7-8fad-0f64ba66ea35 Sep 04 15:58:56 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:56 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3 1073741824" returned: 0 in 0.445s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:56 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3 Sep 04 15:58:56 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:56 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.e29d2740-076f-47f7-8fad-0f64ba66ea35" returned: 0 in 0.259s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-quobyte-e29d2740-076f-47f7-8fad-0f64ba66ea35" released by "_delete_snapshot" :: held 1.560s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-quobyte-420f1914-b32f-4649-9115-95fcac3f7ec7" released by "delete_snapshot" :: held 1.590s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:56 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3" returned: 0 in 0.271s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:58:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:56 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Attempting download of 3fafcfaf-62fa-488a-b1fb-f20894ae5377 ((None, [{'url': 'file:///opt/stack/data/glance/images/3fafcfaf-62fa-488a-b1fb-f20894ae5377', 'metadata': {}}])) to volume 208e3eec-e39e-4c36-95ac-5355552542a3. {{(pid=87513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 15:58:56 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] Created reservations ['22e5aff7-1719-462d-997b-6555dbfb201d', 'dba2668a-f57e-43c6-b04f-2ff4c2b23ab2', '9e810280-913c-4493-b12e-482859e2c251', '6cae2b89-a3a3-4283-81d4-64e6ad8efbf5'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:56 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fe4a99-b355-41a9-a532-bc63c3db10cc]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3fafcfaf-62fa-488a-b1fb-f20894ae5377_3_bwq566 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:56 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] Delete snapshot completed successfully. Sep 04 15:58:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a72cf446-e6c9-4e9e-b9b8-49d2637c0f60 tempest-SnapshotsActionsTest-446137815 None] Lock "cinder-e29d2740-076f-47f7-8fad-0f64ba66ea35-delete_snapshot" released by "delete_snapshot" :: held 1.759s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:56 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3fafcfaf-62fa-488a-b1fb-f20894ae5377_3_bwq566 Sep 04 15:58:56 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:57 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3fafcfaf-62fa-488a-b1fb-f20894ae5377_3_bwq566" returned: 0 in 0.319s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3fafcfaf-62fa-488a-b1fb-f20894ae5377_3_bwq566 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:57 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3fafcfaf-62fa-488a-b1fb-f20894ae5377_3_bwq566 Sep 04 15:58:57 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:57 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3fafcfaf-62fa-488a-b1fb-f20894ae5377_3_bwq566" returned: 1 in 0.333s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3fafcfaf-62fa-488a-b1fb-f20894ae5377_3_bwq566' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:58:57 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc74f20-5e04-4df8-b142-3fb183a080b1]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] Acquiring lock "cinder-497979f4-81af-4670-beab-9a10488ef270-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:57 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD Sep 04 15:58:57 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] Lock "cinder-497979f4-81af-4670-beab-9a10488ef270-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] Acquiring lock "cinder-quobyte-420f1914-b32f-4649-9115-95fcac3f7ec7" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] Lock "cinder-quobyte-420f1914-b32f-4649-9115-95fcac3f7ec7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] Acquiring lock "cinder-quobyte-497979f4-81af-4670-beab-9a10488ef270" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] Lock "cinder-quobyte-497979f4-81af-4670-beab-9a10488ef270" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] Deleting offline snapshot 497979f4-81af-4670-beab-9a10488ef270 of volume 420f1914-b32f-4649-9115-95fcac3f7ec7 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:58:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] snapshot_file for this snap is: volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:58:57 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a689900a-c4ac-434c-894d-fe2c02837a54]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:57 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 Sep 04 15:58:57 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:57 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:57 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD Sep 04 15:58:57 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:57 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270" returned: 0 in 0.380s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420f1914-b32f-4649-9115-95fcac3f7ec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:58:58 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[07574a69-3b75-4157-b0df-fba39290dbed]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:58 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD" returned: 1 in 0.332s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:58:58 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] 3fafcfaf-62fa-488a-b1fb-f20894ae5377 was raw, converting to raw {{(pid=87513) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 15:58:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:58 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3 Sep 04 15:58:58 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:58 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7 Sep 04 15:58:58 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:58 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7" returned: 0 in 0.360s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:58 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 Sep 04 15:58:58 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:58 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3" returned: 0 in 0.358s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:58 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3fafcfaf-62fa-488a-b1fb-f20894ae5377_qtvpp2y5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3 {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:58:58 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 15:58:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:58 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3 1G Sep 04 15:58:58 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:58 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270" returned: 0 in 0.383s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:58 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3 1G" returned: 0 in 0.328s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:58 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270 Sep 04 15:58:58 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:58 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6831e309-e3c8-44a4-b7f3-6000d31c04a1]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:58 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3 Sep 04 15:58:58 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:59 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7.497979f4-81af-4670-beab-9a10488ef270" returned: 0 in 0.296s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] Lock "cinder-quobyte-497979f4-81af-4670-beab-9a10488ef270" released by "_delete_snapshot" :: held 1.555s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] Lock "cinder-quobyte-420f1914-b32f-4649-9115-95fcac3f7ec7" released by "delete_snapshot" :: held 1.585s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Flow 'volume_create_manager' (30629d11-4014-419a-b3b7-00162681a337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e0d04e-baa8-457a-ac05-b65902c7f6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e0d04e-baa8-457a-ac05-b65902c7f6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-125695611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f24ae80c-67fa-4194-8a64-551e451cb225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46ffd5ef9c2478d96d40f41d79dad6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:59Z,use_quota=True,user_id='479bc464084d447bbd47e4f7a5dd9219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bcd8b5-b648-424e-b19d-88b4c02d71bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bcd8b5-b648-424e-b19d-88b4c02d71bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1cec9b-e67c-4e3b-9243-98f1e1c73ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1cec9b-e67c-4e3b-9243-98f1e1c73ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f24ae80c-67fa-4194-8a64-551e451cb225', 'volume_name': 'volume-f24ae80c-67fa-4194-8a64-551e451cb225', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:59 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c81f5e-6f7e-43fb-acee-e070934027dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c81f5e-6f7e-43fb-acee-e070934027dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9153a79-4dcd-43ff-9a69-e32ca54a1846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:59 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Volume f24ae80c-67fa-4194-8a64-551e451cb225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f24ae80c-67fa-4194-8a64-551e451cb225', 'volume_size': 1} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-125695611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f24ae80c-67fa-4194-8a64-551e451cb225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46ffd5ef9c2478d96d40f41d79dad6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:59Z,use_quota=True,user_id='479bc464084d447bbd47e4f7a5dd9219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Creating volume f24ae80c-67fa-4194-8a64-551e451cb225 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:58:59 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f24ae80c-67fa-4194-8a64-551e451cb225 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3" returned: 0 in 0.438s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:59 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f24ae80c-67fa-4194-8a64-551e451cb225 1073741824 Sep 04 15:58:59 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] Created reservations ['4223cbe8-ed9d-403b-a96f-899ac5d359d0', 'cbb87455-72a0-4dc8-9bfb-0b895843d7fc', '9f1a1aae-2f8b-4e35-bb56-c79b6f17f3c4', '2b3c701a-bd7f-4adb-925c-999d111f5e7f'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:59 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] Delete snapshot completed successfully. Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-13593ef9-322f-4d2f-9ed6-db41eda0e3e2 tempest-SnapshotsActionsTest-331879483 None] Lock "cinder-497979f4-81af-4670-beab-9a10488ef270-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:59 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3 Sep 04 15:58:59 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:59 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3" returned: 1 in 0.431s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Downloaded image 3fafcfaf-62fa-488a-b1fb-f20894ae5377 ((None, [{'url': 'file:///opt/stack/data/glance/images/3fafcfaf-62fa-488a-b1fb-f20894ae5377', 'metadata': {}}])) to volume 208e3eec-e39e-4c36-95ac-5355552542a3 successfully. {{(pid=87513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Temporary image 3fafcfaf-62fa-488a-b1fb-f20894ae5377 for user 75eab362d41146528651405cb3954eff is deleted. {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Marking volume 208e3eec-e39e-4c36-95ac-5355552542a3 as bootable. {{(pid=87513) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Copying metadata from image 3fafcfaf-62fa-488a-b1fb-f20894ae5377 to 208e3eec-e39e-4c36-95ac-5355552542a3. {{(pid=87513) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Creating volume glance metadata for volume 208e3eec-e39e-4c36-95ac-5355552542a3 backed by image 3fafcfaf-62fa-488a-b1fb-f20894ae5377 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3fafcfaf-62fa-488a-b1fb-f20894ae5377', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd675212661ce8f15c0c2c8d300041519', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87513) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 15:58:59 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f24ae80c-67fa-4194-8a64-551e451cb225 1073741824" returned: 0 in 0.502s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f24ae80c-67fa-4194-8a64-551e451cb225 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-94c6b505-1b57-461a-b657-e85cd96124ca tempest-SnapshotsActionsTest-331879483 None] Acquiring lock "cinder-420f1914-b32f-4649-9115-95fcac3f7ec7-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:59 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f24ae80c-67fa-4194-8a64-551e451cb225 Sep 04 15:58:59 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (883d038c-aed4-4354-b292-6d5760210b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208e3eec-e39e-4c36-95ac-5355552542a3', 'volume_size': 1, 'image_id': '3fafcfaf-62fa-488a-b1fb-f20894ae5377', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3fafcfaf-62fa-488a-b1fb-f20894ae5377', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd675212661ce8f15c0c2c8d300041519', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '53ce8b3ace5544309aa702357eef5797', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cc64f388cebc1638b677ef624b1c44835f870f69d529c7d4329a419ea26edfc056dd1cec84fbb95ddeb53d29a6b27f2e0098ad8471c7272b86e41540babbd16a', 'id': '3fafcfaf-62fa-488a-b1fb-f20894ae5377', 'created_at': datetime.datetime(2026, 9, 4, 13, 58, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 58, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3fafcfaf-62fa-488a-b1fb-f20894ae5377/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2f0c9c-0420-4aa6-be0b-7cc62c94c238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-94c6b505-1b57-461a-b657-e85cd96124ca tempest-SnapshotsActionsTest-331879483 None] Lock "cinder-420f1914-b32f-4649-9115-95fcac3f7ec7-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:59 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Volume volume-208e3eec-e39e-4c36-95ac-5355552542a3 (208e3eec-e39e-4c36-95ac-5355552542a3): created successfully Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2f0c9c-0420-4aa6-be0b-7cc62c94c238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Flow 'volume_create_manager' (4f6a8452-8372-45d4-b1da-8ecd84ef480f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:59 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-47228677-9525-410a-a3d3-7e7e67859b78 tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Created volume successfully. Sep 04 15:58:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-94c6b505-1b57-461a-b657-e85cd96124ca tempest-SnapshotsActionsTest-331879483 None] Acquiring lock "cinder-quobyte-420f1914-b32f-4649-9115-95fcac3f7ec7" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-94c6b505-1b57-461a-b657-e85cd96124ca tempest-SnapshotsActionsTest-331879483 None] Lock "cinder-quobyte-420f1914-b32f-4649-9115-95fcac3f7ec7" acquired by "delete_volume" :: waited 0.026s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[21afd750-7a3f-46a8-b2d8-e000c8088031]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-94c6b505-1b57-461a-b657-e85cd96124ca tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:00 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f24ae80c-67fa-4194-8a64-551e451cb225" returned: 0 in 0.322s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9153a79-4dcd-43ff-9a69-e32ca54a1846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f24ae80c-67fa-4194-8a64-551e451cb225', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63ae533-f4b0-42cb-ab1a-6711275606d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:00 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Volume volume-f24ae80c-67fa-4194-8a64-551e451cb225 (f24ae80c-67fa-4194-8a64-551e451cb225): created successfully Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63ae533-f4b0-42cb-ab1a-6711275606d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:00 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7 Sep 04 15:59:00 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Flow 'volume_create_manager' (30629d11-4014-419a-b3b7-00162681a337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:00 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-82f28690-1d9c-40e0-91cc-e96db0c20185 tempest-AttachVolumeTestJSON-1615952070 None] Created volume successfully. Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Acquiring lock "cinder-208e3eec-e39e-4c36-95ac-5355552542a3-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Lock "cinder-208e3eec-e39e-4c36-95ac-5355552542a3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Acquiring lock "cinder-quobyte-208e3eec-e39e-4c36-95ac-5355552542a3" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Lock "cinder-quobyte-208e3eec-e39e-4c36-95ac-5355552542a3" acquired by "delete_volume" :: waited 0.025s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac18a94-5133-41c8-a51d-9bfc4744b37a]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:00 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-94c6b505-1b57-461a-b657-e85cd96124ca tempest-SnapshotsActionsTest-331879483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7" returned: 0 in 0.443s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-94c6b505-1b57-461a-b657-e85cd96124ca tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:00 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7 Sep 04 15:59:00 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:00 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3 Sep 04 15:59:00 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:00 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-94c6b505-1b57-461a-b657-e85cd96124ca tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-420f1914-b32f-4649-9115-95fcac3f7ec7" returned: 0 in 0.259s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-94c6b505-1b57-461a-b657-e85cd96124ca tempest-SnapshotsActionsTest-331879483 None] Lock "cinder-quobyte-420f1914-b32f-4649-9115-95fcac3f7ec7" released by "delete_volume" :: held 0.778s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:00 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3" returned: 0 in 0.371s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-94c6b505-1b57-461a-b657-e85cd96124ca tempest-SnapshotsActionsTest-331879483 None] Created reservations ['8f0cbcbf-e751-45a8-9877-7d5ca23e998d', '157e00ae-f4f1-4c7b-acf1-fd302cfe2dec', '8a1397cf-b99b-4367-bd86-6fc2840c83aa', 'd919fc9c-8367-405e-9cfe-950e2ef1fe0f'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:00 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3 Sep 04 15:59:00 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-94c6b505-1b57-461a-b657-e85cd96124ca tempest-SnapshotsActionsTest-331879483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-94c6b505-1b57-461a-b657-e85cd96124ca tempest-SnapshotsActionsTest-331879483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-94c6b505-1b57-461a-b657-e85cd96124ca tempest-SnapshotsActionsTest-331879483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-94c6b505-1b57-461a-b657-e85cd96124ca tempest-SnapshotsActionsTest-331879483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-94c6b505-1b57-461a-b657-e85cd96124ca tempest-SnapshotsActionsTest-331879483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-94c6b505-1b57-461a-b657-e85cd96124ca tempest-SnapshotsActionsTest-331879483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:00 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:00 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:01 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3" returned: 1 in 0.438s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:59:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:01 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3 Sep 04 15:59:01 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:01 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-94c6b505-1b57-461a-b657-e85cd96124ca tempest-SnapshotsActionsTest-331879483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.355s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:01 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-94c6b505-1b57-461a-b657-e85cd96124ca tempest-SnapshotsActionsTest-331879483 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:01 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-94c6b505-1b57-461a-b657-e85cd96124ca tempest-SnapshotsActionsTest-331879483 None] Deleted volume successfully. Sep 04 15:59:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-94c6b505-1b57-461a-b657-e85cd96124ca tempest-SnapshotsActionsTest-331879483 None] Lock "cinder-420f1914-b32f-4649-9115-95fcac3f7ec7-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:01 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-208e3eec-e39e-4c36-95ac-5355552542a3" returned: 0 in 0.300s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Lock "cinder-quobyte-208e3eec-e39e-4c36-95ac-5355552542a3" released by "delete_volume" :: held 1.176s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:01 devstack cinder-volume[87513]: WARNING cinder.quota [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:59:01 devstack cinder-volume[87513]: WARNING cinder.quota [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:59:01 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Created reservations ['97c1d36d-600b-438d-91f0-1fac435a5452', 'b254d216-c89e-4b3a-8833-b07c9d30b8c8', 'b9feffbb-132f-4adf-8a57-9749c17d433c', '1bb20df2-5fcb-42ea-97c2-8cb5a3a55ac3'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:01 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:01 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:01 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:01 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:02 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.314s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:02 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:02 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Deleted volume successfully. Sep 04 15:59:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-ec28c313-4f19-425a-93f7-56d60fd6a1f3 req-03ecb6ff-616b-4e84-ae50-47fb264489ad tempest-AttachVolumeTestJSON-1615952070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-ec28c313-4f19-425a-93f7-56d60fd6a1f3 req-03ecb6ff-616b-4e84-ae50-47fb264489ad tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:02 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-504bd46c-7f77-48a6-91ac-9d0fb92b3c7e tempest-VolumeAndVolumeTypeFromImageTest-790109654 None] Lock "cinder-208e3eec-e39e-4c36-95ac-5355552542a3-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:02 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadccecd-f381-4e45-a4ca-d38b38b7f745]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-ec28c313-4f19-425a-93f7-56d60fd6a1f3 req-03ecb6ff-616b-4e84-ae50-47fb264489ad tempest-AttachVolumeTestJSON-1615952070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f24ae80c-67fa-4194-8a64-551e451cb225 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:02 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f24ae80c-67fa-4194-8a64-551e451cb225 Sep 04 15:59:02 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:02 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-ec28c313-4f19-425a-93f7-56d60fd6a1f3 req-03ecb6ff-616b-4e84-ae50-47fb264489ad tempest-AttachVolumeTestJSON-1615952070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f24ae80c-67fa-4194-8a64-551e451cb225" returned: 0 in 0.378s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-ec28c313-4f19-425a-93f7-56d60fd6a1f3 req-03ecb6ff-616b-4e84-ae50-47fb264489ad tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.399s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-ec28c313-4f19-425a-93f7-56d60fd6a1f3 req-03ecb6ff-616b-4e84-ae50-47fb264489ad tempest-AttachVolumeTestJSON-1615952070 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-f24ae80c-67fa-4194-8a64-551e451cb225', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5eaf1eca-4e24-413c-9275-779163e6ae58', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:59:02 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-ec28c313-4f19-425a-93f7-56d60fd6a1f3 req-03ecb6ff-616b-4e84-ae50-47fb264489ad tempest-AttachVolumeTestJSON-1615952070 None] attachment_update completed successfully. Sep 04 15:59:04 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Flow 'volume_create_manager' (f92f0522-c1e4-441c-89a2-f8f1d09e6521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2fd302f-cb53-4d17-9c08-199393117443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2fd302f-cb53-4d17-9c08-199393117443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-624728298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5e1438-5084-4140-8195-3c531381050c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46ffd5ef9c2478d96d40f41d79dad6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:05Z,use_quota=True,user_id='479bc464084d447bbd47e4f7a5dd9219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0188e7a2-4630-4475-928e-dc14ea1762d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0188e7a2-4630-4475-928e-dc14ea1762d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (071b4428-4d1c-4f7d-8599-16a2303751df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (071b4428-4d1c-4f7d-8599-16a2303751df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa5e1438-5084-4140-8195-3c531381050c', 'volume_name': 'volume-fa5e1438-5084-4140-8195-3c531381050c', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dead6ca8-978f-4d4a-914e-9977719f819f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dead6ca8-978f-4d4a-914e-9977719f819f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf545486-ccda-4c85-9605-f9f289ea051f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:05 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Volume fa5e1438-5084-4140-8195-3c531381050c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa5e1438-5084-4140-8195-3c531381050c', 'volume_size': 1} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-624728298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5e1438-5084-4140-8195-3c531381050c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46ffd5ef9c2478d96d40f41d79dad6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:05Z,use_quota=True,user_id='479bc464084d447bbd47e4f7a5dd9219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Creating volume fa5e1438-5084-4140-8195-3c531381050c {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:59:05 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa5e1438-5084-4140-8195-3c531381050c 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:05 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa5e1438-5084-4140-8195-3c531381050c 1073741824 Sep 04 15:59:05 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:05 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa5e1438-5084-4140-8195-3c531381050c 1073741824" returned: 0 in 0.514s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa5e1438-5084-4140-8195-3c531381050c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:05 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa5e1438-5084-4140-8195-3c531381050c Sep 04 15:59:05 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:05 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa5e1438-5084-4140-8195-3c531381050c" returned: 0 in 0.290s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf545486-ccda-4c85-9605-f9f289ea051f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa5e1438-5084-4140-8195-3c531381050c', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3aee801-02c4-4ccc-a5d9-6051df3cd073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:06 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Volume volume-fa5e1438-5084-4140-8195-3c531381050c (fa5e1438-5084-4140-8195-3c531381050c): created successfully Sep 04 15:59:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3aee801-02c4-4ccc-a5d9-6051df3cd073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Flow 'volume_create_manager' (f92f0522-c1e4-441c-89a2-f8f1d09e6521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:06 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-cb812407-6d73-4577-a4fa-7c0756a7645d tempest-AttachVolumeTestJSON-1615952070 None] Created volume successfully. Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Flow 'volume_create_manager' (e0751f23-54f5-49d4-a33d-4a28ce3fdf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af85556-cf74-4306-af74-60a5903d1f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af85556-cf74-4306-af74-60a5903d1f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-566958218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a92cdc-00c2-4424-83a5-195638587cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31cfeae56704070b6c1e8071116fdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:08Z,use_quota=True,user_id='12897b075e574389acefaf53d671a462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe73fd43-a6a2-4063-b329-14cbe366f83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe73fd43-a6a2-4063-b329-14cbe366f83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358f5ea8-92be-493c-b2d7-af94b3d734fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358f5ea8-92be-493c-b2d7-af94b3d734fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45a92cdc-00c2-4424-83a5-195638587cb7', 'volume_name': 'volume-45a92cdc-00c2-4424-83a5-195638587cb7', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3357f5e8-22ff-45c5-808b-4ba60a6737b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3357f5e8-22ff-45c5-808b-4ba60a6737b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e93dc6-92c3-4b4c-afc4-04460c26b239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:07 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Volume 45a92cdc-00c2-4424-83a5-195638587cb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45a92cdc-00c2-4424-83a5-195638587cb7', 'volume_size': 1} Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-566958218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a92cdc-00c2-4424-83a5-195638587cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31cfeae56704070b6c1e8071116fdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:08Z,use_quota=True,user_id='12897b075e574389acefaf53d671a462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Creating volume 45a92cdc-00c2-4424-83a5-195638587cb7 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:59:07 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:59:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-45a92cdc-00c2-4424-83a5-195638587cb7 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:07 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-45a92cdc-00c2-4424-83a5-195638587cb7 1073741824 Sep 04 15:59:07 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Flow 'volume_create_manager' (38fd8532-80eb-4812-922a-8e402e3a5a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a463e190-63d4-4204-aa2b-5bf273920f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a463e190-63d4-4204-aa2b-5bf273920f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-599683930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31cfeae56704070b6c1e8071116fdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:08Z,use_quota=True,user_id='12897b075e574389acefaf53d671a462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4cf165f-f248-46a5-980a-5642cab39774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4cf165f-f248-46a5-980a-5642cab39774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7725397b-5736-40fa-b5ec-ec4caf2d445b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7725397b-5736-40fa-b5ec-ec4caf2d445b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869', 'volume_name': 'volume-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9af31f-97d0-4bb0-8850-099de501cb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9af31f-97d0-4bb0-8850-099de501cb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871d9906-e3bc-4e0a-9aa3-dc2cc302858a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:08 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Volume 2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869', 'volume_size': 1} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-86be9f7e-5b91-4d75-ba7a-d5f1bc036436 req-7f2ab811-9ffa-463b-b4ce-e120b5258688 tempest-AttachVolumeTestJSON-1615952070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:08 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-45a92cdc-00c2-4424-83a5-195638587cb7 1073741824" returned: 0 in 0.686s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-45a92cdc-00c2-4424-83a5-195638587cb7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:08 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-45a92cdc-00c2-4424-83a5-195638587cb7 Sep 04 15:59:08 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Flow 'volume_create_manager' (d2a48483-87ff-4277-a693-7486754dd6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c36aa7-be5a-4cf1-8971-c103a1d3ad2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c36aa7-be5a-4cf1-8971-c103a1d3ad2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1276968289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72490629-a168-4111-acd7-030f641ddced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31cfeae56704070b6c1e8071116fdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:09Z,use_quota=True,user_id='12897b075e574389acefaf53d671a462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02aab6f1-466d-4357-adc3-533d65fe92a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02aab6f1-466d-4357-adc3-533d65fe92a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7915d4fc-3527-42e9-b121-551a49fdc21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7915d4fc-3527-42e9-b121-551a49fdc21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72490629-a168-4111-acd7-030f641ddced', 'volume_name': 'volume-72490629-a168-4111-acd7-030f641ddced', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62408411-b6ea-4fa4-8d0d-9c82f7cb9969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62408411-b6ea-4fa4-8d0d-9c82f7cb9969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c375a8-00f6-454d-af93-b911aedbf402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:08 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Volume 72490629-a168-4111-acd7-030f641ddced: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72490629-a168-4111-acd7-030f641ddced', 'volume_size': 1} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:08 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-45a92cdc-00c2-4424-83a5-195638587cb7" returned: 0 in 0.273s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.384s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-599683930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31cfeae56704070b6c1e8071116fdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:08Z,use_quota=True,user_id='12897b075e574389acefaf53d671a462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Creating volume 2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:59:08 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e93dc6-92c3-4b4c-afc4-04460c26b239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45a92cdc-00c2-4424-83a5-195638587cb7', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:08 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869 1073741824 Sep 04 15:59:08 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1965b167-e6b7-4cd4-9343-c75727e5a409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:08 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Volume volume-45a92cdc-00c2-4424-83a5-195638587cb7 (45a92cdc-00c2-4424-83a5-195638587cb7): created successfully Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1965b167-e6b7-4cd4-9343-c75727e5a409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Flow 'volume_create_manager' (e0751f23-54f5-49d4-a33d-4a28ce3fdf4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:08 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-bf30c5fa-a579-45b4-90ae-2396293248c6 tempest-CreateVolumesFromImageTest-461288011 None] Created volume successfully. Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Flow 'volume_create_manager' (0e7308e3-efc0-4666-993a-68355ce43660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed7c40d-5109-448b-9fa2-43406aa0332e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed7c40d-5109-448b-9fa2-43406aa0332e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-785025218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d16c00-fa7a-4147-b74c-a0d9805d82db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89c109255894caea29bec8703f685bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:09Z,use_quota=True,user_id='ac74e83f1a1c48f4848c2a3d70ec702b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a19e7b-feca-4a3c-a8f3-5309efffa822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a19e7b-feca-4a3c-a8f3-5309efffa822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:09 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b5d9b8-8a3d-4b8a-869e-847fe7ca35c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b5d9b8-8a3d-4b8a-869e-847fe7ca35c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15d16c00-fa7a-4147-b74c-a0d9805d82db', 'volume_name': 'volume-15d16c00-fa7a-4147-b74c-a0d9805d82db', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342e6827-e082-4efa-a334-fd325bbf336d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342e6827-e082-4efa-a334-fd325bbf336d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39bf5afa-061c-4131-8b66-3d7197c0275e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:09 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Volume 15d16c00-fa7a-4147-b74c-a0d9805d82db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15d16c00-fa7a-4147-b74c-a0d9805d82db', 'volume_size': 1} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869 1073741824" returned: 0 in 0.551s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:09 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869 Sep 04 15:59:09 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Flow 'volume_create_manager' (b373b307-cf4e-43d0-9cc2-fa5b5b8960d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1aa7b83-9b90-474f-aebe-1c38f6ad48d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1aa7b83-9b90-474f-aebe-1c38f6ad48d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1777662187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c9e8a7-b630-4f03-992e-5cff96431559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31cfeae56704070b6c1e8071116fdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:10Z,use_quota=True,user_id='12897b075e574389acefaf53d671a462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f446f8a-f4e2-4052-9717-cf87cb97f499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:09 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f446f8a-f4e2-4052-9717-cf87cb97f499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e2c4b1a-6a4c-4675-9286-d2e88ce9f8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e2c4b1a-6a4c-4675-9286-d2e88ce9f8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8c9e8a7-b630-4f03-992e-5cff96431559', 'volume_name': 'volume-b8c9e8a7-b630-4f03-992e-5cff96431559', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a644677-d725-417a-ada8-fb7defd2c190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a644677-d725-417a-ada8-fb7defd2c190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71f8812-f46e-4afa-a38a-15ae72a3538e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:09 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Volume b8c9e8a7-b630-4f03-992e-5cff96431559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8c9e8a7-b630-4f03-992e-5cff96431559', 'volume_size': 1} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869" returned: 0 in 0.311s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-86be9f7e-5b91-4d75-ba7a-d5f1bc036436 req-7f2ab811-9ffa-463b-b4ce-e120b5258688 tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.285s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871d9906-e3bc-4e0a-9aa3-dc2cc302858a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1017baca-5661-4fbf-92eb-5934ce016986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7c6811-02e2-4814-b202-f6eed513195a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-86be9f7e-5b91-4d75-ba7a-d5f1bc036436 req-7f2ab811-9ffa-463b-b4ce-e120b5258688 tempest-AttachVolumeTestJSON-1615952070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa5e1438-5084-4140-8195-3c531381050c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:09 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Volume volume-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869 (2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869): created successfully Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1017baca-5661-4fbf-92eb-5934ce016986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:09 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Flow 'volume_create_manager' (38fd8532-80eb-4812-922a-8e402e3a5a6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:09 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-6079d610-f778-46f7-8d92-bd8e9792cabf tempest-CreateVolumesFromImageTest-461288011 None] Created volume successfully. Sep 04 15:59:09 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa5e1438-5084-4140-8195-3c531381050c Sep 04 15:59:09 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Flow 'volume_create_manager' (188ac1ed-373d-4b34-a815-18a2f7d553dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6896b594-8148-4726-9630-cb20ad76b1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6896b594-8148-4726-9630-cb20ad76b1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-93637393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78504876-3f5c-4be4-a842-2ea839c4668d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31cfeae56704070b6c1e8071116fdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:10Z,use_quota=True,user_id='12897b075e574389acefaf53d671a462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a516c07-a155-4f97-a63d-c2adefc08f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a516c07-a155-4f97-a63d-c2adefc08f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb233be5-190a-4cf2-b764-f752788092c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb233be5-190a-4cf2-b764-f752788092c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78504876-3f5c-4be4-a842-2ea839c4668d', 'volume_name': 'volume-78504876-3f5c-4be4-a842-2ea839c4668d', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb3ffd1-96f8-464b-bb18-00eb54940b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:10 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb3ffd1-96f8-464b-bb18-00eb54940b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e79c079-7f27-43c8-a033-78e7c3748512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:10 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Volume 78504876-3f5c-4be4-a842-2ea839c4668d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78504876-3f5c-4be4-a842-2ea839c4668d', 'volume_size': 1} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-86be9f7e-5b91-4d75-ba7a-d5f1bc036436 req-7f2ab811-9ffa-463b-b4ce-e120b5258688 tempest-AttachVolumeTestJSON-1615952070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa5e1438-5084-4140-8195-3c531381050c" returned: 0 in 0.411s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-86be9f7e-5b91-4d75-ba7a-d5f1bc036436 req-7f2ab811-9ffa-463b-b4ce-e120b5258688 tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.438s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.369s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1276968289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72490629-a168-4111-acd7-030f641ddced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31cfeae56704070b6c1e8071116fdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:09Z,use_quota=True,user_id='12897b075e574389acefaf53d671a462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Creating volume 72490629-a168-4111-acd7-030f641ddced {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:59:10 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-72490629-a168-4111-acd7-030f641ddced 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:10 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-72490629-a168-4111-acd7-030f641ddced 1073741824 Sep 04 15:59:10 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-86be9f7e-5b91-4d75-ba7a-d5f1bc036436 req-7f2ab811-9ffa-463b-b4ce-e120b5258688 tempest-AttachVolumeTestJSON-1615952070 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-fa5e1438-5084-4140-8195-3c531381050c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e98ea55-0b76-4945-a953-d754f2e54f5c', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:59:10 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-86be9f7e-5b91-4d75-ba7a-d5f1bc036436 req-7f2ab811-9ffa-463b-b4ce-e120b5258688 tempest-AttachVolumeTestJSON-1615952070 None] attachment_update completed successfully. Sep 04 15:59:10 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-72490629-a168-4111-acd7-030f641ddced 1073741824" returned: 0 in 0.495s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-72490629-a168-4111-acd7-030f641ddced {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:10 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-72490629-a168-4111-acd7-030f641ddced Sep 04 15:59:10 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:10 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-72490629-a168-4111-acd7-030f641ddced" returned: 0 in 0.238s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.578s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-785025218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d16c00-fa7a-4147-b74c-a0d9805d82db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89c109255894caea29bec8703f685bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:09Z,use_quota=True,user_id='ac74e83f1a1c48f4848c2a3d70ec702b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Creating volume 15d16c00-fa7a-4147-b74c-a0d9805d82db {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:59:10 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-15d16c00-fa7a-4147-b74c-a0d9805d82db 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:10 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-15d16c00-fa7a-4147-b74c-a0d9805d82db 1073741824 Sep 04 15:59:10 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c375a8-00f6-454d-af93-b911aedbf402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72490629-a168-4111-acd7-030f641ddced', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:10 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490c77c6-874f-44e1-9fde-b0192c2f2981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:11 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Volume volume-72490629-a168-4111-acd7-030f641ddced (72490629-a168-4111-acd7-030f641ddced): created successfully Sep 04 15:59:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490c77c6-874f-44e1-9fde-b0192c2f2981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Flow 'volume_create_manager' (d2a48483-87ff-4277-a693-7486754dd6ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:11 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e59907e5-7e97-4364-82db-ed403ef7ce9b tempest-CreateVolumesFromImageTest-461288011 None] Created volume successfully. Sep 04 15:59:11 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-15d16c00-fa7a-4147-b74c-a0d9805d82db 1073741824" returned: 0 in 0.412s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-15d16c00-fa7a-4147-b74c-a0d9805d82db {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:11 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-15d16c00-fa7a-4147-b74c-a0d9805d82db Sep 04 15:59:11 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:11 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-15d16c00-fa7a-4147-b74c-a0d9805d82db" returned: 0 in 0.266s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.955s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1777662187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c9e8a7-b630-4f03-992e-5cff96431559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31cfeae56704070b6c1e8071116fdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:10Z,use_quota=True,user_id='12897b075e574389acefaf53d671a462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Creating volume b8c9e8a7-b630-4f03-992e-5cff96431559 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:59:11 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:59:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b8c9e8a7-b630-4f03-992e-5cff96431559 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39bf5afa-061c-4131-8b66-3d7197c0275e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15d16c00-fa7a-4147-b74c-a0d9805d82db', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:11 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b8c9e8a7-b630-4f03-992e-5cff96431559 1073741824 Sep 04 15:59:11 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fec4d35-4264-4dcf-94f9-48660ef95465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:11 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Volume volume-15d16c00-fa7a-4147-b74c-a0d9805d82db (15d16c00-fa7a-4147-b74c-a0d9805d82db): created successfully Sep 04 15:59:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fec4d35-4264-4dcf-94f9-48660ef95465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Flow 'volume_create_manager' (0e7308e3-efc0-4666-993a-68355ce43660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:11 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-d6bef5b6-efe2-4b26-82cc-65860f241210 tempest-VolumeQuotasAdminTestJSON-249913128 None] Created volume successfully. Sep 04 15:59:12 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b8c9e8a7-b630-4f03-992e-5cff96431559 1073741824" returned: 0 in 0.455s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b8c9e8a7-b630-4f03-992e-5cff96431559 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:12 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b8c9e8a7-b630-4f03-992e-5cff96431559 Sep 04 15:59:12 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:12 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b8c9e8a7-b630-4f03-992e-5cff96431559" returned: 0 in 0.263s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.298s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-93637393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78504876-3f5c-4be4-a842-2ea839c4668d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31cfeae56704070b6c1e8071116fdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:10Z,use_quota=True,user_id='12897b075e574389acefaf53d671a462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Creating volume 78504876-3f5c-4be4-a842-2ea839c4668d {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:59:12 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-78504876-3f5c-4be4-a842-2ea839c4668d 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71f8812-f46e-4afa-a38a-15ae72a3538e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8c9e8a7-b630-4f03-992e-5cff96431559', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:12 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-78504876-3f5c-4be4-a842-2ea839c4668d 1073741824 Sep 04 15:59:12 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56480ce3-3654-412b-8583-9aa540871f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:12 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Volume volume-b8c9e8a7-b630-4f03-992e-5cff96431559 (b8c9e8a7-b630-4f03-992e-5cff96431559): created successfully Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56480ce3-3654-412b-8583-9aa540871f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Flow 'volume_create_manager' (b373b307-cf4e-43d0-9cc2-fa5b5b8960d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:12 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-8f29c69a-3c6c-40e6-b4d8-998ab4361300 tempest-CreateVolumesFromImageTest-461288011 None] Created volume successfully. Sep 04 15:59:12 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-4c2d0e0f-e9f5-4b63-ba42-3369af0c05e1 req-47ca63a5-e490-4f04-bd76-abe51ccf421c tempest-AttachVolumeTestJSON-1615952070 None] Terminate volume connection completed successfully. Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-4c2d0e0f-e9f5-4b63-ba42-3369af0c05e1 req-47ca63a5-e490-4f04-bd76-abe51ccf421c tempest-AttachVolumeTestJSON-1615952070 None] Deleting attachment 5eaf1eca-4e24-413c-9275-779163e6ae58. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8aa0f3c8-b64a-40ff-978d-d0f78ee01976 tempest-VolumeQuotasAdminTestJSON-249913128 None] Acquiring lock "cinder-15d16c00-fa7a-4147-b74c-a0d9805d82db-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8aa0f3c8-b64a-40ff-978d-d0f78ee01976 tempest-VolumeQuotasAdminTestJSON-249913128 None] Lock "cinder-15d16c00-fa7a-4147-b74c-a0d9805d82db-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8aa0f3c8-b64a-40ff-978d-d0f78ee01976 tempest-VolumeQuotasAdminTestJSON-249913128 None] Acquiring lock "cinder-quobyte-15d16c00-fa7a-4147-b74c-a0d9805d82db" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8aa0f3c8-b64a-40ff-978d-d0f78ee01976 tempest-VolumeQuotasAdminTestJSON-249913128 None] Lock "cinder-quobyte-15d16c00-fa7a-4147-b74c-a0d9805d82db" acquired by "delete_volume" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[309b32fb-a7fc-452c-ac5b-7d10d73f1135]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8aa0f3c8-b64a-40ff-978d-d0f78ee01976 tempest-VolumeQuotasAdminTestJSON-249913128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-15d16c00-fa7a-4147-b74c-a0d9805d82db {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:12 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-78504876-3f5c-4be4-a842-2ea839c4668d 1073741824" returned: 0 in 0.520s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-78504876-3f5c-4be4-a842-2ea839c4668d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:13 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-78504876-3f5c-4be4-a842-2ea839c4668d Sep 04 15:59:13 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:13 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-15d16c00-fa7a-4147-b74c-a0d9805d82db Sep 04 15:59:13 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:13 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-78504876-3f5c-4be4-a842-2ea839c4668d" returned: 0 in 0.237s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e79c079-7f27-43c8-a033-78e7c3748512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78504876-3f5c-4be4-a842-2ea839c4668d', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853c8fa9-ddb7-4776-88cf-d08524f19f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:13 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Volume volume-78504876-3f5c-4be4-a842-2ea839c4668d (78504876-3f5c-4be4-a842-2ea839c4668d): created successfully Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853c8fa9-ddb7-4776-88cf-d08524f19f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Flow 'volume_create_manager' (188ac1ed-373d-4b34-a815-18a2f7d553dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:13 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-7407579d-735a-4ce0-8616-4339b1a29646 tempest-CreateVolumesFromImageTest-461288011 None] Created volume successfully. Sep 04 15:59:13 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8aa0f3c8-b64a-40ff-978d-d0f78ee01976 tempest-VolumeQuotasAdminTestJSON-249913128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-15d16c00-fa7a-4147-b74c-a0d9805d82db" returned: 0 in 0.402s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8aa0f3c8-b64a-40ff-978d-d0f78ee01976 tempest-VolumeQuotasAdminTestJSON-249913128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-15d16c00-fa7a-4147-b74c-a0d9805d82db {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:13 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-15d16c00-fa7a-4147-b74c-a0d9805d82db Sep 04 15:59:13 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c67b1acf-e4cf-4852-ae50-478217f7f4ca tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "cinder-78504876-3f5c-4be4-a842-2ea839c4668d-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c67b1acf-e4cf-4852-ae50-478217f7f4ca tempest-CreateVolumesFromImageTest-461288011 None] Lock "cinder-78504876-3f5c-4be4-a842-2ea839c4668d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c67b1acf-e4cf-4852-ae50-478217f7f4ca tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "cinder-quobyte-78504876-3f5c-4be4-a842-2ea839c4668d" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c67b1acf-e4cf-4852-ae50-478217f7f4ca tempest-CreateVolumesFromImageTest-461288011 None] Lock "cinder-quobyte-78504876-3f5c-4be4-a842-2ea839c4668d" acquired by "delete_volume" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[290608d5-eb47-455d-9ddf-ca66e5a55701]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c67b1acf-e4cf-4852-ae50-478217f7f4ca tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-78504876-3f5c-4be4-a842-2ea839c4668d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:13 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8aa0f3c8-b64a-40ff-978d-d0f78ee01976 tempest-VolumeQuotasAdminTestJSON-249913128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-15d16c00-fa7a-4147-b74c-a0d9805d82db" returned: 0 in 0.294s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8aa0f3c8-b64a-40ff-978d-d0f78ee01976 tempest-VolumeQuotasAdminTestJSON-249913128 None] Lock "cinder-quobyte-15d16c00-fa7a-4147-b74c-a0d9805d82db" released by "delete_volume" :: held 0.748s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:13 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-78504876-3f5c-4be4-a842-2ea839c4668d Sep 04 15:59:13 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-8aa0f3c8-b64a-40ff-978d-d0f78ee01976 tempest-VolumeQuotasAdminTestJSON-249913128 None] Created reservations ['afd48a5a-bc32-4a51-a214-ca45522e921c', '590b39b6-01fc-4551-a083-2fd054a89af5', '51e33d73-addd-4e3f-88ee-c8ceec936f76', '46912ae5-2062-45de-bf8a-3c4bc4d5a559'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8aa0f3c8-b64a-40ff-978d-d0f78ee01976 tempest-VolumeQuotasAdminTestJSON-249913128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8aa0f3c8-b64a-40ff-978d-d0f78ee01976 tempest-VolumeQuotasAdminTestJSON-249913128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8aa0f3c8-b64a-40ff-978d-d0f78ee01976 tempest-VolumeQuotasAdminTestJSON-249913128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8aa0f3c8-b64a-40ff-978d-d0f78ee01976 tempest-VolumeQuotasAdminTestJSON-249913128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8aa0f3c8-b64a-40ff-978d-d0f78ee01976 tempest-VolumeQuotasAdminTestJSON-249913128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8aa0f3c8-b64a-40ff-978d-d0f78ee01976 tempest-VolumeQuotasAdminTestJSON-249913128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:13 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:13 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:14 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c67b1acf-e4cf-4852-ae50-478217f7f4ca tempest-CreateVolumesFromImageTest-461288011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-78504876-3f5c-4be4-a842-2ea839c4668d" returned: 0 in 0.443s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c67b1acf-e4cf-4852-ae50-478217f7f4ca tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-78504876-3f5c-4be4-a842-2ea839c4668d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:14 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-78504876-3f5c-4be4-a842-2ea839c4668d Sep 04 15:59:14 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:14 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-cda76d8f-5642-4e8a-8d03-043dc1ba99e8 req-5c542785-c29e-49a3-99c1-c70b2771fd21 tempest-AttachVolumeTestJSON-1615952070 None] Terminate volume connection completed successfully. Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-cda76d8f-5642-4e8a-8d03-043dc1ba99e8 req-5c542785-c29e-49a3-99c1-c70b2771fd21 tempest-AttachVolumeTestJSON-1615952070 None] Deleting attachment 9e98ea55-0b76-4945-a953-d754f2e54f5c. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:59:14 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8aa0f3c8-b64a-40ff-978d-d0f78ee01976 tempest-VolumeQuotasAdminTestJSON-249913128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.342s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-8aa0f3c8-b64a-40ff-978d-d0f78ee01976 tempest-VolumeQuotasAdminTestJSON-249913128 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:14 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-8aa0f3c8-b64a-40ff-978d-d0f78ee01976 tempest-VolumeQuotasAdminTestJSON-249913128 None] Deleted volume successfully. Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8aa0f3c8-b64a-40ff-978d-d0f78ee01976 tempest-VolumeQuotasAdminTestJSON-249913128 None] Lock "cinder-15d16c00-fa7a-4147-b74c-a0d9805d82db-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:14 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c67b1acf-e4cf-4852-ae50-478217f7f4ca tempest-CreateVolumesFromImageTest-461288011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-78504876-3f5c-4be4-a842-2ea839c4668d" returned: 0 in 0.341s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c67b1acf-e4cf-4852-ae50-478217f7f4ca tempest-CreateVolumesFromImageTest-461288011 None] Lock "cinder-quobyte-78504876-3f5c-4be4-a842-2ea839c4668d" released by "delete_volume" :: held 0.840s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-c67b1acf-e4cf-4852-ae50-478217f7f4ca tempest-CreateVolumesFromImageTest-461288011 None] Created reservations ['d27061c5-e868-43a7-b715-734e0964a398', 'cbaeb074-2666-403f-9a04-b8ea558848a3', 'd013917b-b6fb-4f41-b25a-50bf41fe0877', 'e118bd6e-9e49-46e0-92f7-88ab6485de91'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c67b1acf-e4cf-4852-ae50-478217f7f4ca tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c67b1acf-e4cf-4852-ae50-478217f7f4ca tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c67b1acf-e4cf-4852-ae50-478217f7f4ca tempest-CreateVolumesFromImageTest-461288011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c67b1acf-e4cf-4852-ae50-478217f7f4ca tempest-CreateVolumesFromImageTest-461288011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c67b1acf-e4cf-4852-ae50-478217f7f4ca tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c67b1acf-e4cf-4852-ae50-478217f7f4ca tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:14 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:14 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-53226d6f-5e31-417b-ba3b-2523074f94c9 tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "cinder-b8c9e8a7-b630-4f03-992e-5cff96431559-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-53226d6f-5e31-417b-ba3b-2523074f94c9 tempest-CreateVolumesFromImageTest-461288011 None] Lock "cinder-b8c9e8a7-b630-4f03-992e-5cff96431559-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Flow 'volume_create_manager' (a3d431b5-8d02-4220-b828-d5a340449305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cdb2602-abd2-44bb-8519-80b82c9240b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cdb2602-abd2-44bb-8519-80b82c9240b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-6386943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b6d27c-c993-40f1-981b-f11ed47e5583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89c109255894caea29bec8703f685bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:15Z,use_quota=True,user_id='ac74e83f1a1c48f4848c2a3d70ec702b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49d4392-22a7-412d-837f-e3803b1f91a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49d4392-22a7-412d-837f-e3803b1f91a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97ad40b-603f-41d3-94e1-c9827f9a0617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97ad40b-603f-41d3-94e1-c9827f9a0617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68b6d27c-c993-40f1-981b-f11ed47e5583', 'volume_name': 'volume-68b6d27c-c993-40f1-981b-f11ed47e5583', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c617485-5554-4323-993c-148ef4b8822e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c617485-5554-4323-993c-148ef4b8822e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f161131c-a22a-4206-b2da-aa0f695a4b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:14 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Volume 68b6d27c-c993-40f1-981b-f11ed47e5583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68b6d27c-c993-40f1-981b-f11ed47e5583', 'volume_size': 1} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-6386943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b6d27c-c993-40f1-981b-f11ed47e5583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89c109255894caea29bec8703f685bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:15Z,use_quota=True,user_id='ac74e83f1a1c48f4848c2a3d70ec702b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Creating volume 68b6d27c-c993-40f1-981b-f11ed47e5583 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:59:14 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-68b6d27c-c993-40f1-981b-f11ed47e5583 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-53226d6f-5e31-417b-ba3b-2523074f94c9 tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "cinder-quobyte-b8c9e8a7-b630-4f03-992e-5cff96431559" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:14 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c67b1acf-e4cf-4852-ae50-478217f7f4ca tempest-CreateVolumesFromImageTest-461288011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.342s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-c67b1acf-e4cf-4852-ae50-478217f7f4ca tempest-CreateVolumesFromImageTest-461288011 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:14 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-68b6d27c-c993-40f1-981b-f11ed47e5583 1073741824 Sep 04 15:59:14 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:14 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-c67b1acf-e4cf-4852-ae50-478217f7f4ca tempest-CreateVolumesFromImageTest-461288011 None] Deleted volume successfully. Sep 04 15:59:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-53226d6f-5e31-417b-ba3b-2523074f94c9 tempest-CreateVolumesFromImageTest-461288011 None] Lock "cinder-quobyte-b8c9e8a7-b630-4f03-992e-5cff96431559" acquired by "delete_volume" :: waited 0.029s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:15 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[332ad008-8700-4623-a97e-eff9ddb0f374]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-53226d6f-5e31-417b-ba3b-2523074f94c9 tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b8c9e8a7-b630-4f03-992e-5cff96431559 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:15 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c67b1acf-e4cf-4852-ae50-478217f7f4ca tempest-CreateVolumesFromImageTest-461288011 None] Lock "cinder-78504876-3f5c-4be4-a842-2ea839c4668d-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:15 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b8c9e8a7-b630-4f03-992e-5cff96431559 Sep 04 15:59:15 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:15 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-53226d6f-5e31-417b-ba3b-2523074f94c9 tempest-CreateVolumesFromImageTest-461288011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b8c9e8a7-b630-4f03-992e-5cff96431559" returned: 0 in 0.511s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-53226d6f-5e31-417b-ba3b-2523074f94c9 tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b8c9e8a7-b630-4f03-992e-5cff96431559 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:15 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b8c9e8a7-b630-4f03-992e-5cff96431559 Sep 04 15:59:15 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:15 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-68b6d27c-c993-40f1-981b-f11ed47e5583 1073741824" returned: 0 in 0.768s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-68b6d27c-c993-40f1-981b-f11ed47e5583 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:15 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-68b6d27c-c993-40f1-981b-f11ed47e5583 Sep 04 15:59:15 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:15 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-53226d6f-5e31-417b-ba3b-2523074f94c9 tempest-CreateVolumesFromImageTest-461288011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b8c9e8a7-b630-4f03-992e-5cff96431559" returned: 0 in 0.407s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-53226d6f-5e31-417b-ba3b-2523074f94c9 tempest-CreateVolumesFromImageTest-461288011 None] Lock "cinder-quobyte-b8c9e8a7-b630-4f03-992e-5cff96431559" released by "delete_volume" :: held 1.026s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:16 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-53226d6f-5e31-417b-ba3b-2523074f94c9 tempest-CreateVolumesFromImageTest-461288011 None] Created reservations ['94afd181-7a4f-4cc2-8b4b-22a3856bbef3', 'bc9973a7-633e-4ecb-b01a-e58dc572f94a', 'fdd7b158-dcec-49fc-91b0-9ceb684ce6a7', '94803eb9-3deb-4f7f-967d-d4e13e2d7ca2'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:16 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-68b6d27c-c993-40f1-981b-f11ed47e5583" returned: 0 in 0.496s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:16 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f161131c-a22a-4206-b2da-aa0f695a4b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68b6d27c-c993-40f1-981b-f11ed47e5583', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:16 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8fee0a-f073-4cc9-9e4b-8076347696e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:16 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Volume volume-68b6d27c-c993-40f1-981b-f11ed47e5583 (68b6d27c-c993-40f1-981b-f11ed47e5583): created successfully Sep 04 15:59:16 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8fee0a-f073-4cc9-9e4b-8076347696e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:16 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Flow 'volume_create_manager' (a3d431b5-8d02-4220-b828-d5a340449305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:16 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-63a271a1-b959-4985-9032-782cc9710411 tempest-VolumeQuotasAdminTestJSON-249913128 None] Created volume successfully. Sep 04 15:59:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-53226d6f-5e31-417b-ba3b-2523074f94c9 tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-53226d6f-5e31-417b-ba3b-2523074f94c9 tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-53226d6f-5e31-417b-ba3b-2523074f94c9 tempest-CreateVolumesFromImageTest-461288011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-53226d6f-5e31-417b-ba3b-2523074f94c9 tempest-CreateVolumesFromImageTest-461288011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-53226d6f-5e31-417b-ba3b-2523074f94c9 tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-53226d6f-5e31-417b-ba3b-2523074f94c9 tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:16 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:16 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:16 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-53226d6f-5e31-417b-ba3b-2523074f94c9 tempest-CreateVolumesFromImageTest-461288011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.436s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:16 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-53226d6f-5e31-417b-ba3b-2523074f94c9 tempest-CreateVolumesFromImageTest-461288011 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:16 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-53226d6f-5e31-417b-ba3b-2523074f94c9 tempest-CreateVolumesFromImageTest-461288011 None] Deleted volume successfully. Sep 04 15:59:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-53226d6f-5e31-417b-ba3b-2523074f94c9 tempest-CreateVolumesFromImageTest-461288011 None] Lock "cinder-b8c9e8a7-b630-4f03-992e-5cff96431559-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e69f9ba8-ea4f-4878-822d-58e32aebef49 tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "cinder-72490629-a168-4111-acd7-030f641ddced-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e69f9ba8-ea4f-4878-822d-58e32aebef49 tempest-CreateVolumesFromImageTest-461288011 None] Lock "cinder-72490629-a168-4111-acd7-030f641ddced-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e69f9ba8-ea4f-4878-822d-58e32aebef49 tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "cinder-quobyte-72490629-a168-4111-acd7-030f641ddced" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e69f9ba8-ea4f-4878-822d-58e32aebef49 tempest-CreateVolumesFromImageTest-461288011 None] Lock "cinder-quobyte-72490629-a168-4111-acd7-030f641ddced" acquired by "delete_volume" :: waited 0.026s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:17 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[15510b8e-8f5c-4ffc-aed1-240611221908]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e69f9ba8-ea4f-4878-822d-58e32aebef49 tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-72490629-a168-4111-acd7-030f641ddced {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:17 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-72490629-a168-4111-acd7-030f641ddced Sep 04 15:59:17 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:18 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e69f9ba8-ea4f-4878-822d-58e32aebef49 tempest-CreateVolumesFromImageTest-461288011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-72490629-a168-4111-acd7-030f641ddced" returned: 0 in 0.594s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e69f9ba8-ea4f-4878-822d-58e32aebef49 tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-72490629-a168-4111-acd7-030f641ddced {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:18 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-72490629-a168-4111-acd7-030f641ddced Sep 04 15:59:18 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:18 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-4015e0d8-ded7-407e-9a95-b6cd8c0dbe6a tempest-VolumeQuotasAdminTestJSON-1264071644 None] Transfer volume completed successfully. Sep 04 15:59:18 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e69f9ba8-ea4f-4878-822d-58e32aebef49 tempest-CreateVolumesFromImageTest-461288011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-72490629-a168-4111-acd7-030f641ddced" returned: 0 in 0.479s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:18 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e69f9ba8-ea4f-4878-822d-58e32aebef49 tempest-CreateVolumesFromImageTest-461288011 None] Lock "cinder-quobyte-72490629-a168-4111-acd7-030f641ddced" released by "delete_volume" :: held 1.167s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:18 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-e69f9ba8-ea4f-4878-822d-58e32aebef49 tempest-CreateVolumesFromImageTest-461288011 None] Created reservations ['56e0acd5-90df-4d78-8fa9-3f178f430f38', 'af153dee-6436-4dd0-9ef5-7f101efa70e0', '48bf5874-f0d7-45e7-9afa-cb54ded947a7', '5f46feb2-82de-4246-ba30-1d9b15ae03eb'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:18 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-25221c44-c27b-41b4-84a6-5dcc9bc1784a tempest-TestShelveInstance-1372791885 None] Terminate volume connection completed successfully. Sep 04 15:59:18 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-25221c44-c27b-41b4-84a6-5dcc9bc1784a tempest-TestShelveInstance-1372791885 None] Deleting attachment cadf431f-0450-456a-8dee-ff42c221a0ee. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:59:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e69f9ba8-ea4f-4878-822d-58e32aebef49 tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e69f9ba8-ea4f-4878-822d-58e32aebef49 tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:18 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e69f9ba8-ea4f-4878-822d-58e32aebef49 tempest-CreateVolumesFromImageTest-461288011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:18 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e69f9ba8-ea4f-4878-822d-58e32aebef49 tempest-CreateVolumesFromImageTest-461288011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e69f9ba8-ea4f-4878-822d-58e32aebef49 tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e69f9ba8-ea4f-4878-822d-58e32aebef49 tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:18 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:18 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-79979ce7-6fa6-4610-b5f0-24876d7d4c24 tempest-VolumeQuotasAdminTestJSON-1533970476 None] Acquiring lock "cinder-68b6d27c-c993-40f1-981b-f11ed47e5583-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-79979ce7-6fa6-4610-b5f0-24876d7d4c24 tempest-VolumeQuotasAdminTestJSON-1533970476 None] Lock "cinder-68b6d27c-c993-40f1-981b-f11ed47e5583-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] Acquiring lock "cinder-2f3d40a6-d96d-46d1-9978-d2448016a70c-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:19 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e69f9ba8-ea4f-4878-822d-58e32aebef49 tempest-CreateVolumesFromImageTest-461288011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.329s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-e69f9ba8-ea4f-4878-822d-58e32aebef49 tempest-CreateVolumesFromImageTest-461288011 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:19 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e69f9ba8-ea4f-4878-822d-58e32aebef49 tempest-CreateVolumesFromImageTest-461288011 None] Deleted volume successfully. Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] Lock "cinder-2f3d40a6-d96d-46d1-9978-d2448016a70c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-79979ce7-6fa6-4610-b5f0-24876d7d4c24 tempest-VolumeQuotasAdminTestJSON-1533970476 None] Acquiring lock "cinder-quobyte-68b6d27c-c993-40f1-981b-f11ed47e5583" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e69f9ba8-ea4f-4878-822d-58e32aebef49 tempest-CreateVolumesFromImageTest-461288011 None] Lock "cinder-72490629-a168-4111-acd7-030f641ddced-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-79979ce7-6fa6-4610-b5f0-24876d7d4c24 tempest-VolumeQuotasAdminTestJSON-1533970476 None] Lock "cinder-quobyte-68b6d27c-c993-40f1-981b-f11ed47e5583" acquired by "delete_volume" :: waited 0.027s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] Acquiring lock "cinder-quobyte-2f3d40a6-d96d-46d1-9978-d2448016a70c" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3099f2af-90dc-4d9f-821c-f093122103c9]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79979ce7-6fa6-4610-b5f0-24876d7d4c24 tempest-VolumeQuotasAdminTestJSON-1533970476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-68b6d27c-c993-40f1-981b-f11ed47e5583 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] Lock "cinder-quobyte-2f3d40a6-d96d-46d1-9978-d2448016a70c" acquired by "delete_volume" :: waited 0.031s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac0da5d-ed2b-445a-ad8a-24ffa6316d94]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:19 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-68b6d27c-c993-40f1-981b-f11ed47e5583 Sep 04 15:59:19 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:19 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c Sep 04 15:59:19 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ac560fe5-fa73-4b1a-9f05-ed9989bcc284 tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "cinder-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ac560fe5-fa73-4b1a-9f05-ed9989bcc284 tempest-CreateVolumesFromImageTest-461288011 None] Lock "cinder-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ac560fe5-fa73-4b1a-9f05-ed9989bcc284 tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "cinder-quobyte-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:19 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79979ce7-6fa6-4610-b5f0-24876d7d4c24 tempest-VolumeQuotasAdminTestJSON-1533970476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-68b6d27c-c993-40f1-981b-f11ed47e5583" returned: 0 in 0.521s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79979ce7-6fa6-4610-b5f0-24876d7d4c24 tempest-VolumeQuotasAdminTestJSON-1533970476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-68b6d27c-c993-40f1-981b-f11ed47e5583 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ac560fe5-fa73-4b1a-9f05-ed9989bcc284 tempest-CreateVolumesFromImageTest-461288011 None] Lock "cinder-quobyte-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869" acquired by "delete_volume" :: waited 0.037s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:19 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-68b6d27c-c993-40f1-981b-f11ed47e5583 Sep 04 15:59:19 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0985278-fc6c-4f8c-8f3b-b326586d864e]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac560fe5-fa73-4b1a-9f05-ed9989bcc284 tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:19 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c" returned: 0 in 0.497s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:19 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c Sep 04 15:59:19 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:20 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869 Sep 04 15:59:20 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:20 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79979ce7-6fa6-4610-b5f0-24876d7d4c24 tempest-VolumeQuotasAdminTestJSON-1533970476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-68b6d27c-c993-40f1-981b-f11ed47e5583" returned: 0 in 0.343s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-79979ce7-6fa6-4610-b5f0-24876d7d4c24 tempest-VolumeQuotasAdminTestJSON-1533970476 None] Lock "cinder-quobyte-68b6d27c-c993-40f1-981b-f11ed47e5583" released by "delete_volume" :: held 0.933s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-79979ce7-6fa6-4610-b5f0-24876d7d4c24 tempest-VolumeQuotasAdminTestJSON-1533970476 None] Created reservations ['7e776dc4-8ff0-4352-a9c1-2728209b039b', '4419d45d-e034-4c9c-adb0-c29f00ef595f', '0a3f949b-aad8-49a1-8809-b2fc62d841a2', '3a1c0920-7197-4708-8080-6cd408b8f0ec'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-79979ce7-6fa6-4610-b5f0-24876d7d4c24 tempest-VolumeQuotasAdminTestJSON-1533970476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-79979ce7-6fa6-4610-b5f0-24876d7d4c24 tempest-VolumeQuotasAdminTestJSON-1533970476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-79979ce7-6fa6-4610-b5f0-24876d7d4c24 tempest-VolumeQuotasAdminTestJSON-1533970476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-79979ce7-6fa6-4610-b5f0-24876d7d4c24 tempest-VolumeQuotasAdminTestJSON-1533970476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-79979ce7-6fa6-4610-b5f0-24876d7d4c24 tempest-VolumeQuotasAdminTestJSON-1533970476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79979ce7-6fa6-4610-b5f0-24876d7d4c24 tempest-VolumeQuotasAdminTestJSON-1533970476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:20 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c" returned: 1 in 0.578s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:20 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:20 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:20 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac560fe5-fa73-4b1a-9f05-ed9989bcc284 tempest-CreateVolumesFromImageTest-461288011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869" returned: 0 in 0.635s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac560fe5-fa73-4b1a-9f05-ed9989bcc284 tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:20 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c Sep 04 15:59:20 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:20 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869 Sep 04 15:59:20 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:20 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2f3d40a6-d96d-46d1-9978-d2448016a70c" returned: 0 in 0.326s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:20 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79979ce7-6fa6-4610-b5f0-24876d7d4c24 tempest-VolumeQuotasAdminTestJSON-1533970476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.375s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-79979ce7-6fa6-4610-b5f0-24876d7d4c24 tempest-VolumeQuotasAdminTestJSON-1533970476 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] Lock "cinder-quobyte-2f3d40a6-d96d-46d1-9978-d2448016a70c" released by "delete_volume" :: held 1.514s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:20 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:20 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-79979ce7-6fa6-4610-b5f0-24876d7d4c24 tempest-VolumeQuotasAdminTestJSON-1533970476 None] Deleted volume successfully. Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac560fe5-fa73-4b1a-9f05-ed9989bcc284 tempest-CreateVolumesFromImageTest-461288011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869" returned: 0 in 0.358s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ac560fe5-fa73-4b1a-9f05-ed9989bcc284 tempest-CreateVolumesFromImageTest-461288011 None] Lock "cinder-quobyte-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869" released by "delete_volume" :: held 1.070s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-79979ce7-6fa6-4610-b5f0-24876d7d4c24 tempest-VolumeQuotasAdminTestJSON-1533970476 None] Lock "cinder-68b6d27c-c993-40f1-981b-f11ed47e5583-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=126,cinder:INSERT=40,cinder:UPDATE=133,cinder:DELETE=10 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=133,cinder:UPDATE=141,cinder:DELETE=14,cinder:INSERT=34 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG cinder.quota [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] Created reservations ['3efc59b3-60e0-4b4b-97a8-64fb24272f86', 'd6c6955a-5010-48cc-96f4-c55ccc5963c8', '5b1665e0-d96b-424d-9a39-efb68d1a7742', '57d98cb1-f3b8-4277-bcb6-e5edf4700de0'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:20 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-ac560fe5-fa73-4b1a-9f05-ed9989bcc284 tempest-CreateVolumesFromImageTest-461288011 None] Created reservations ['b67543e0-9a90-4c5d-98b6-2bd2b4a0c165', '6e4e5935-f80a-4d52-872c-bf3ed2cd0265', 'fea2fb06-aaf1-43c7-979f-ab691325abb7', '7c167632-59e8-4710-a06f-1268ef5a1c9c'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:21 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:21 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ac560fe5-fa73-4b1a-9f05-ed9989bcc284 tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ac560fe5-fa73-4b1a-9f05-ed9989bcc284 tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ac560fe5-fa73-4b1a-9f05-ed9989bcc284 tempest-CreateVolumesFromImageTest-461288011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ac560fe5-fa73-4b1a-9f05-ed9989bcc284 tempest-CreateVolumesFromImageTest-461288011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ac560fe5-fa73-4b1a-9f05-ed9989bcc284 tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac560fe5-fa73-4b1a-9f05-ed9989bcc284 tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:21 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:21 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-632e64ce-eccd-41c2-8d60-d108824c0fd4 tempest-AttachVolumeTestJSON-1615952070 None] Acquiring lock "cinder-fa5e1438-5084-4140-8195-3c531381050c-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-632e64ce-eccd-41c2-8d60-d108824c0fd4 tempest-AttachVolumeTestJSON-1615952070 None] Lock "cinder-fa5e1438-5084-4140-8195-3c531381050c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-632e64ce-eccd-41c2-8d60-d108824c0fd4 tempest-AttachVolumeTestJSON-1615952070 None] Acquiring lock "cinder-quobyte-fa5e1438-5084-4140-8195-3c531381050c" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-632e64ce-eccd-41c2-8d60-d108824c0fd4 tempest-AttachVolumeTestJSON-1615952070 None] Lock "cinder-quobyte-fa5e1438-5084-4140-8195-3c531381050c" acquired by "delete_volume" :: waited 0.022s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[34108470-f794-464e-ba1a-d93813c22ff5]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-632e64ce-eccd-41c2-8d60-d108824c0fd4 tempest-AttachVolumeTestJSON-1615952070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa5e1438-5084-4140-8195-3c531381050c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:21 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.389s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG cinder.manager [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:21 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] Deleted volume successfully. Sep 04 15:59:21 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-7ed4ac23-1de9-46a1-86a3-b3d832ecc830 req-c499c773-7d59-46a5-80e8-18bf1a09d0ea tempest-TestShelveInstance-1372791885 None] Lock "cinder-2f3d40a6-d96d-46d1-9978-d2448016a70c-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac560fe5-fa73-4b1a-9f05-ed9989bcc284 tempest-CreateVolumesFromImageTest-461288011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.340s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-ac560fe5-fa73-4b1a-9f05-ed9989bcc284 tempest-CreateVolumesFromImageTest-461288011 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:21 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ac560fe5-fa73-4b1a-9f05-ed9989bcc284 tempest-CreateVolumesFromImageTest-461288011 None] Deleted volume successfully. Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ac560fe5-fa73-4b1a-9f05-ed9989bcc284 tempest-CreateVolumesFromImageTest-461288011 None] Lock "cinder-2c9257e3-b2fd-4ace-8cf1-b49c7c6c7869-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:21 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa5e1438-5084-4140-8195-3c531381050c Sep 04 15:59:21 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:21 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-632e64ce-eccd-41c2-8d60-d108824c0fd4 tempest-AttachVolumeTestJSON-1615952070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa5e1438-5084-4140-8195-3c531381050c" returned: 0 in 0.486s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-632e64ce-eccd-41c2-8d60-d108824c0fd4 tempest-AttachVolumeTestJSON-1615952070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa5e1438-5084-4140-8195-3c531381050c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:21 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa5e1438-5084-4140-8195-3c531381050c Sep 04 15:59:21 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:21 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f1bb0f05-2d42-408a-9853-36b0d2454bc0 tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "cinder-45a92cdc-00c2-4424-83a5-195638587cb7-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f1bb0f05-2d42-408a-9853-36b0d2454bc0 tempest-CreateVolumesFromImageTest-461288011 None] Lock "cinder-45a92cdc-00c2-4424-83a5-195638587cb7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f1bb0f05-2d42-408a-9853-36b0d2454bc0 tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "cinder-quobyte-45a92cdc-00c2-4424-83a5-195638587cb7" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f1bb0f05-2d42-408a-9853-36b0d2454bc0 tempest-CreateVolumesFromImageTest-461288011 None] Lock "cinder-quobyte-45a92cdc-00c2-4424-83a5-195638587cb7" acquired by "delete_volume" :: waited 0.021s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[76db1446-2ed2-4aa0-abb5-9febd3c87d3e]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f1bb0f05-2d42-408a-9853-36b0d2454bc0 tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-45a92cdc-00c2-4424-83a5-195638587cb7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:22 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-632e64ce-eccd-41c2-8d60-d108824c0fd4 tempest-AttachVolumeTestJSON-1615952070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fa5e1438-5084-4140-8195-3c531381050c" returned: 0 in 0.366s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-632e64ce-eccd-41c2-8d60-d108824c0fd4 tempest-AttachVolumeTestJSON-1615952070 None] Lock "cinder-quobyte-fa5e1438-5084-4140-8195-3c531381050c" released by "delete_volume" :: held 0.921s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:22 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-45a92cdc-00c2-4424-83a5-195638587cb7 Sep 04 15:59:22 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-632e64ce-eccd-41c2-8d60-d108824c0fd4 tempest-AttachVolumeTestJSON-1615952070 None] Created reservations ['09c7c3e4-0bb2-4704-affc-2de0769d9b48', '0e3f6940-f4e3-4f00-8632-b7f4a20c43d1', '5170e56f-8fab-4be7-a8c2-60a623504bf3', '695992d1-daba-473b-ae0a-f115d490d9c9'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-632e64ce-eccd-41c2-8d60-d108824c0fd4 tempest-AttachVolumeTestJSON-1615952070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-632e64ce-eccd-41c2-8d60-d108824c0fd4 tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-632e64ce-eccd-41c2-8d60-d108824c0fd4 tempest-AttachVolumeTestJSON-1615952070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-632e64ce-eccd-41c2-8d60-d108824c0fd4 tempest-AttachVolumeTestJSON-1615952070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-632e64ce-eccd-41c2-8d60-d108824c0fd4 tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-632e64ce-eccd-41c2-8d60-d108824c0fd4 tempest-AttachVolumeTestJSON-1615952070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:22 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:22 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:22 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f1bb0f05-2d42-408a-9853-36b0d2454bc0 tempest-CreateVolumesFromImageTest-461288011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-45a92cdc-00c2-4424-83a5-195638587cb7" returned: 0 in 0.453s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f1bb0f05-2d42-408a-9853-36b0d2454bc0 tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-45a92cdc-00c2-4424-83a5-195638587cb7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:22 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-45a92cdc-00c2-4424-83a5-195638587cb7 Sep 04 15:59:22 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:22 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-632e64ce-eccd-41c2-8d60-d108824c0fd4 tempest-AttachVolumeTestJSON-1615952070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.339s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-632e64ce-eccd-41c2-8d60-d108824c0fd4 tempest-AttachVolumeTestJSON-1615952070 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:22 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-632e64ce-eccd-41c2-8d60-d108824c0fd4 tempest-AttachVolumeTestJSON-1615952070 None] Deleted volume successfully. Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-632e64ce-eccd-41c2-8d60-d108824c0fd4 tempest-AttachVolumeTestJSON-1615952070 None] Lock "cinder-fa5e1438-5084-4140-8195-3c531381050c-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:22 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f1bb0f05-2d42-408a-9853-36b0d2454bc0 tempest-CreateVolumesFromImageTest-461288011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-45a92cdc-00c2-4424-83a5-195638587cb7" returned: 0 in 0.293s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f1bb0f05-2d42-408a-9853-36b0d2454bc0 tempest-CreateVolumesFromImageTest-461288011 None] Lock "cinder-quobyte-45a92cdc-00c2-4424-83a5-195638587cb7" released by "delete_volume" :: held 0.799s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:22 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-f1bb0f05-2d42-408a-9853-36b0d2454bc0 tempest-CreateVolumesFromImageTest-461288011 None] Created reservations ['8765e90d-7f69-4de0-87cb-ea7dd4080b04', 'b24a7230-25bc-4967-abbc-d8c8f751f231', '89242195-e7f4-4d8c-9596-af9b080bc28e', '528e3870-e9bf-4219-b142-4394cd8ec72e'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f1bb0f05-2d42-408a-9853-36b0d2454bc0 tempest-CreateVolumesFromImageTest-461288011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f1bb0f05-2d42-408a-9853-36b0d2454bc0 tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f1bb0f05-2d42-408a-9853-36b0d2454bc0 tempest-CreateVolumesFromImageTest-461288011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f1bb0f05-2d42-408a-9853-36b0d2454bc0 tempest-CreateVolumesFromImageTest-461288011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f1bb0f05-2d42-408a-9853-36b0d2454bc0 tempest-CreateVolumesFromImageTest-461288011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f1bb0f05-2d42-408a-9853-36b0d2454bc0 tempest-CreateVolumesFromImageTest-461288011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:23 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:23 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:23 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f1bb0f05-2d42-408a-9853-36b0d2454bc0 tempest-CreateVolumesFromImageTest-461288011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.304s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:23 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-f1bb0f05-2d42-408a-9853-36b0d2454bc0 tempest-CreateVolumesFromImageTest-461288011 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:23 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-f1bb0f05-2d42-408a-9853-36b0d2454bc0 tempest-CreateVolumesFromImageTest-461288011 None] Deleted volume successfully. Sep 04 15:59:23 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f1bb0f05-2d42-408a-9853-36b0d2454bc0 tempest-CreateVolumesFromImageTest-461288011 None] Lock "cinder-45a92cdc-00c2-4424-83a5-195638587cb7-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:23 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-69682e78-b499-4cf4-b014-b3977b8cc1f7 tempest-AttachVolumeTestJSON-1615952070 None] Acquiring lock "cinder-f24ae80c-67fa-4194-8a64-551e451cb225-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:23 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-69682e78-b499-4cf4-b014-b3977b8cc1f7 tempest-AttachVolumeTestJSON-1615952070 None] Lock "cinder-f24ae80c-67fa-4194-8a64-551e451cb225-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:23 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-69682e78-b499-4cf4-b014-b3977b8cc1f7 tempest-AttachVolumeTestJSON-1615952070 None] Acquiring lock "cinder-quobyte-f24ae80c-67fa-4194-8a64-551e451cb225" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:23 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-69682e78-b499-4cf4-b014-b3977b8cc1f7 tempest-AttachVolumeTestJSON-1615952070 None] Lock "cinder-quobyte-f24ae80c-67fa-4194-8a64-551e451cb225" acquired by "delete_volume" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:23 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3fc6d4-b43c-422b-9d59-251b21e0e9ef]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-69682e78-b499-4cf4-b014-b3977b8cc1f7 tempest-AttachVolumeTestJSON-1615952070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f24ae80c-67fa-4194-8a64-551e451cb225 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:23 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f24ae80c-67fa-4194-8a64-551e451cb225 Sep 04 15:59:23 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:24 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-69682e78-b499-4cf4-b014-b3977b8cc1f7 tempest-AttachVolumeTestJSON-1615952070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f24ae80c-67fa-4194-8a64-551e451cb225" returned: 0 in 0.431s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-69682e78-b499-4cf4-b014-b3977b8cc1f7 tempest-AttachVolumeTestJSON-1615952070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f24ae80c-67fa-4194-8a64-551e451cb225 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:24 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f24ae80c-67fa-4194-8a64-551e451cb225 Sep 04 15:59:24 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:24 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-69682e78-b499-4cf4-b014-b3977b8cc1f7 tempest-AttachVolumeTestJSON-1615952070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-f24ae80c-67fa-4194-8a64-551e451cb225" returned: 0 in 0.282s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:24 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-69682e78-b499-4cf4-b014-b3977b8cc1f7 tempest-AttachVolumeTestJSON-1615952070 None] Lock "cinder-quobyte-f24ae80c-67fa-4194-8a64-551e451cb225" released by "delete_volume" :: held 0.763s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:24 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-69682e78-b499-4cf4-b014-b3977b8cc1f7 tempest-AttachVolumeTestJSON-1615952070 None] Created reservations ['375c2c48-2f46-4125-a8cd-eb5d086f45c1', 'bb644957-7c2e-4e66-a6f9-bbbf3e0e43fb', '62eea023-2178-4cc9-a5f0-81c9ed789f62', '8946b9c9-a222-40b6-ba1f-906aa350ca1f'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-69682e78-b499-4cf4-b014-b3977b8cc1f7 tempest-AttachVolumeTestJSON-1615952070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-69682e78-b499-4cf4-b014-b3977b8cc1f7 tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:24 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-69682e78-b499-4cf4-b014-b3977b8cc1f7 tempest-AttachVolumeTestJSON-1615952070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:24 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-69682e78-b499-4cf4-b014-b3977b8cc1f7 tempest-AttachVolumeTestJSON-1615952070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-69682e78-b499-4cf4-b014-b3977b8cc1f7 tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-69682e78-b499-4cf4-b014-b3977b8cc1f7 tempest-AttachVolumeTestJSON-1615952070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:24 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:24 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:24 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-69682e78-b499-4cf4-b014-b3977b8cc1f7 tempest-AttachVolumeTestJSON-1615952070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.354s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:24 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-69682e78-b499-4cf4-b014-b3977b8cc1f7 tempest-AttachVolumeTestJSON-1615952070 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:24 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-69682e78-b499-4cf4-b014-b3977b8cc1f7 tempest-AttachVolumeTestJSON-1615952070 None] Deleted volume successfully. Sep 04 15:59:24 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-03667d73-47a6-43f0-ad78-93b873a321c9 tempest-AttachVolumeTestJSON-1615952070 None] Acquiring lock "cinder-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:24 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-03667d73-47a6-43f0-ad78-93b873a321c9 tempest-AttachVolumeTestJSON-1615952070 None] Lock "cinder-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:24 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-69682e78-b499-4cf4-b014-b3977b8cc1f7 tempest-AttachVolumeTestJSON-1615952070 None] Lock "cinder-f24ae80c-67fa-4194-8a64-551e451cb225-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-03667d73-47a6-43f0-ad78-93b873a321c9 tempest-AttachVolumeTestJSON-1615952070 None] Acquiring lock "cinder-quobyte-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-03667d73-47a6-43f0-ad78-93b873a321c9 tempest-AttachVolumeTestJSON-1615952070 None] Lock "cinder-quobyte-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e" acquired by "delete_volume" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:25 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ea8b1a-aae9-45d5-a8d1-9079de14e4b9]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-03667d73-47a6-43f0-ad78-93b873a321c9 tempest-AttachVolumeTestJSON-1615952070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:25 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e Sep 04 15:59:25 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:25 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-03667d73-47a6-43f0-ad78-93b873a321c9 tempest-AttachVolumeTestJSON-1615952070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e" returned: 0 in 0.407s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-03667d73-47a6-43f0-ad78-93b873a321c9 tempest-AttachVolumeTestJSON-1615952070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:25 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e Sep 04 15:59:25 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:25 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-03667d73-47a6-43f0-ad78-93b873a321c9 tempest-AttachVolumeTestJSON-1615952070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e" returned: 0 in 0.355s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-03667d73-47a6-43f0-ad78-93b873a321c9 tempest-AttachVolumeTestJSON-1615952070 None] Lock "cinder-quobyte-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e" released by "delete_volume" :: held 0.809s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:25 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-03667d73-47a6-43f0-ad78-93b873a321c9 tempest-AttachVolumeTestJSON-1615952070 None] Created reservations ['4cbc7227-2192-45d1-9583-236525fea81c', '388a241a-8c11-46dc-9230-78d3f485ad6e', '196b5adb-1bcb-4f8e-a66f-d93456c4fbf4', '9a4d62ef-9bcc-43ba-afbd-4d5d483c162b'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-03667d73-47a6-43f0-ad78-93b873a321c9 tempest-AttachVolumeTestJSON-1615952070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-03667d73-47a6-43f0-ad78-93b873a321c9 tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-03667d73-47a6-43f0-ad78-93b873a321c9 tempest-AttachVolumeTestJSON-1615952070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-03667d73-47a6-43f0-ad78-93b873a321c9 tempest-AttachVolumeTestJSON-1615952070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-03667d73-47a6-43f0-ad78-93b873a321c9 tempest-AttachVolumeTestJSON-1615952070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-03667d73-47a6-43f0-ad78-93b873a321c9 tempest-AttachVolumeTestJSON-1615952070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:26 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:26 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:26 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-03667d73-47a6-43f0-ad78-93b873a321c9 tempest-AttachVolumeTestJSON-1615952070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.319s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:26 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-03667d73-47a6-43f0-ad78-93b873a321c9 tempest-AttachVolumeTestJSON-1615952070 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:26 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-03667d73-47a6-43f0-ad78-93b873a321c9 tempest-AttachVolumeTestJSON-1615952070 None] Deleted volume successfully. Sep 04 15:59:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-03667d73-47a6-43f0-ad78-93b873a321c9 tempest-AttachVolumeTestJSON-1615952070 None] Lock "cinder-c2dd58bb-6e5d-412f-9eb3-2fd39ec06e1e-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Flow 'volume_create_manager' (31a2cfff-a523-43f0-98c2-06fab705afd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d66be7-ab2a-4002-9aa6-9bd6a3f5fac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d66be7-ab2a-4002-9aa6-9bd6a3f5fac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2098685275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f9f02d7-a650-4d92-b2d5-6fc73f91b68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bcf8f87ec2143eba2e8bf3b997aa624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:28Z,use_quota=True,user_id='6e261f4cf947412191724eb870d7354f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cba2e3f-7bd0-4d7b-915b-6150ff680d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cba2e3f-7bd0-4d7b-915b-6150ff680d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051c0d65-3905-47e1-a2c7-7327bf769b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051c0d65-3905-47e1-a2c7-7327bf769b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f9f02d7-a650-4d92-b2d5-6fc73f91b68d', 'volume_name': 'volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d621a659-9da9-4367-9141-c04ec6eac271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d621a659-9da9-4367-9141-c04ec6eac271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ec3c73-41ce-475e-a8d0-4f533fe94665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:28 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Volume 0f9f02d7-a650-4d92-b2d5-6fc73f91b68d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d', 'volume_size': 1} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2098685275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f9f02d7-a650-4d92-b2d5-6fc73f91b68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bcf8f87ec2143eba2e8bf3b997aa624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:28Z,use_quota=True,user_id='6e261f4cf947412191724eb870d7354f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Creating volume 0f9f02d7-a650-4d92-b2d5-6fc73f91b68d {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:59:28 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:28 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d 1073741824 Sep 04 15:59:28 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:28 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d 1073741824" returned: 0 in 0.596s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:28 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d Sep 04 15:59:28 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:29 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d" returned: 0 in 0.271s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:29 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ec3c73-41ce-475e-a8d0-4f533fe94665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d196a73-208c-418a-ab54-a5cf275ce7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:29 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Volume volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d (0f9f02d7-a650-4d92-b2d5-6fc73f91b68d): created successfully Sep 04 15:59:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d196a73-208c-418a-ab54-a5cf275ce7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Flow 'volume_create_manager' (31a2cfff-a523-43f0-98c2-06fab705afd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:29 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-8610a4d6-e16e-462e-89e0-1be4813aa130 tempest-VolumeDependencyTests-2119845617 None] Created volume successfully. Sep 04 15:59:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-20edd597-449d-461d-be25-ed61b6309c81 tempest-VolumeDependencyTests-2119845617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-20edd597-449d-461d-be25-ed61b6309c81 tempest-VolumeDependencyTests-2119845617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-20edd597-449d-461d-be25-ed61b6309c81 tempest-VolumeDependencyTests-2119845617 None] Creating offline snapshot 6a387760-a9a0-40e3-83dc-d6c39b071645 of volume 0f9f02d7-a650-4d92-b2d5-6fc73f91b68d {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:59:30 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa77ace2-0a15-4b39-852c-c18e55eeec13]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-20edd597-449d-461d-be25-ed61b6309c81 tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:30 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d Sep 04 15:59:30 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:31 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-20edd597-449d-461d-be25-ed61b6309c81 tempest-VolumeDependencyTests-2119845617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d" returned: 0 in 0.492s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-20edd597-449d-461d-be25-ed61b6309c81 tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:31 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645 1G Sep 04 15:59:31 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:31 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-20edd597-449d-461d-be25-ed61b6309c81 tempest-VolumeDependencyTests-2119845617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645 1G" returned: 0 in 0.504s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-20edd597-449d-461d-be25-ed61b6309c81 tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:31 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645 Sep 04 15:59:31 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:32 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-20edd597-449d-461d-be25-ed61b6309c81 tempest-VolumeDependencyTests-2119845617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645" returned: 0 in 0.437s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:32 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-20edd597-449d-461d-be25-ed61b6309c81 tempest-VolumeDependencyTests-2119845617 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645 is being set with open permissions: ugo+rw Sep 04 15:59:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-20edd597-449d-461d-be25-ed61b6309c81 tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:32 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645 Sep 04 15:59:32 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:32 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-20edd597-449d-461d-be25-ed61b6309c81 tempest-VolumeDependencyTests-2119845617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645" returned: 0 in 0.311s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-20edd597-449d-461d-be25-ed61b6309c81 tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:32 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.info Sep 04 15:59:32 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:32 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-20edd597-449d-461d-be25-ed61b6309c81 tempest-VolumeDependencyTests-2119845617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.info" returned: 0 in 0.344s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:32 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-20edd597-449d-461d-be25-ed61b6309c81 tempest-VolumeDependencyTests-2119845617 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.info is being set with open permissions: ugo+rw Sep 04 15:59:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-20edd597-449d-461d-be25-ed61b6309c81 tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:32 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.info Sep 04 15:59:32 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:33 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-20edd597-449d-461d-be25-ed61b6309c81 tempest-VolumeDependencyTests-2119845617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.info" returned: 0 in 0.317s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-20edd597-449d-461d-be25-ed61b6309c81 tempest-VolumeDependencyTests-2119845617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.553s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:33 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-20edd597-449d-461d-be25-ed61b6309c81 tempest-VolumeDependencyTests-2119845617 None] Create snapshot completed successfully Sep 04 15:59:33 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Flow 'volume_create_manager' (1d1baaef-7423-4ba7-ad44-99a6598e6428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28abe4c8-f877-43b1-a2c3-ab9207d10c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28abe4c8-f877-43b1-a2c3-ab9207d10c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1961630244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183e6f06-98c1-47b3-a762-ffc21ed370f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5118c5a92564545987d0f5e2382d759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:34Z,use_quota=True,user_id='ff55c948d35d439b8775290885c2d32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109d9ca0-198a-4717-9d56-8c761b8f9a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109d9ca0-198a-4717-9d56-8c761b8f9a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e057da7d-e6d7-4159-b115-e0c3220331ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e057da7d-e6d7-4159-b115-e0c3220331ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '183e6f06-98c1-47b3-a762-ffc21ed370f7', 'volume_name': 'volume-183e6f06-98c1-47b3-a762-ffc21ed370f7', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71744b95-2f72-4b15-87ea-3947a7eeec16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71744b95-2f72-4b15-87ea-3947a7eeec16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c29002c-4cdb-4527-8b32-294c7ab2e0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:34 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Volume 183e6f06-98c1-47b3-a762-ffc21ed370f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-183e6f06-98c1-47b3-a762-ffc21ed370f7', 'volume_size': 1} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1961630244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183e6f06-98c1-47b3-a762-ffc21ed370f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5118c5a92564545987d0f5e2382d759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:34Z,use_quota=True,user_id='ff55c948d35d439b8775290885c2d32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Creating volume 183e6f06-98c1-47b3-a762-ffc21ed370f7 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:59:34 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-183e6f06-98c1-47b3-a762-ffc21ed370f7 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:34 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-183e6f06-98c1-47b3-a762-ffc21ed370f7 1073741824 Sep 04 15:59:34 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Flow 'volume_create_manager' (c18eb5f5-798b-4430-8b96-cc36b7f9d39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa10bfdc-965e-4ab2-9505-c0be697c5933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa10bfdc-965e-4ab2-9505-c0be697c5933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1117735051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de25991-89d1-4a9c-b7f3-d950ffd94053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bcf8f87ec2143eba2e8bf3b997aa624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6a387760-a9a0-40e3-83dc-d6c39b071645,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:35Z,use_quota=True,user_id='6e261f4cf947412191724eb870d7354f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e75636e-6253-4dea-9305-e32bf8d8b047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e75636e-6253-4dea-9305-e32bf8d8b047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a67e6b-6189-483c-ae9e-3cade81798f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a67e6b-6189-483c-ae9e-3cade81798f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4de25991-89d1-4a9c-b7f3-d950ffd94053', 'volume_name': 'volume-4de25991-89d1-4a9c-b7f3-d950ffd94053', 'volume_size': 1, 'snapshot_id': '6a387760-a9a0-40e3-83dc-d6c39b071645'}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f948d65-735b-4de6-8e7f-ede91e5fa978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f948d65-735b-4de6-8e7f-ede91e5fa978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72238e7d-aa2c-4d95-844f-42a59894a8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:34 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Volume 4de25991-89d1-4a9c-b7f3-d950ffd94053: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4de25991-89d1-4a9c-b7f3-d950ffd94053', 'volume_size': 1, 'snapshot_id': '6a387760-a9a0-40e3-83dc-d6c39b071645'} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:34 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-183e6f06-98c1-47b3-a762-ffc21ed370f7 1073741824" returned: 0 in 0.584s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-183e6f06-98c1-47b3-a762-ffc21ed370f7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:34 devstack sudo[99959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-183e6f06-98c1-47b3-a762-ffc21ed370f7 Sep 04 15:59:34 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:34 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:34 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:35 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-183e6f06-98c1-47b3-a762-ffc21ed370f7" returned: 0 in 0.293s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.356s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Acquiring lock "cinder-quobyte-6a387760-a9a0-40e3-83dc-d6c39b071645-4de25991-89d1-4a9c-b7f3-d950ffd94053" by "_create_volume_from_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c29002c-4cdb-4527-8b32-294c7ab2e0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-183e6f06-98c1-47b3-a762-ffc21ed370f7', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdab831-934a-404f-985f-5c9bd9109415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Lock "cinder-quobyte-6a387760-a9a0-40e3-83dc-d6c39b071645-4de25991-89d1-4a9c-b7f3-d950ffd94053" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Creating volume 4de25991-89d1-4a9c-b7f3-d950ffd94053 from snapshot 6a387760-a9a0-40e3-83dc-d6c39b071645 {{(pid=87513) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Acquiring lock "cinder-quobyte-4de25991-89d1-4a9c-b7f3-d950ffd94053" by "_copy_volume_from_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:35 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Volume volume-183e6f06-98c1-47b3-a762-ffc21ed370f7 (183e6f06-98c1-47b3-a762-ffc21ed370f7): created successfully Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdab831-934a-404f-985f-5c9bd9109415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Flow 'volume_create_manager' (1d1baaef-7423-4ba7-ad44-99a6598e6428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Lock "cinder-quobyte-4de25991-89d1-4a9c-b7f3-d950ffd94053" acquired by "_copy_volume_from_snapshot" :: waited 0.058s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] snapshot: 6a387760-a9a0-40e3-83dc-d6c39b071645, volume: 4de25991-89d1-4a9c-b7f3-d950ffd94053, {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:35 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:35 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-340c5a7f-77dc-4fab-8a98-af527f577b72 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Created volume successfully. Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.324s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9661a585-12a0-41f6-871b-037b7217d330]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 28 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:35 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645 Sep 04 15:59:35 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:35 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645" returned: 0 in 0.456s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] will copy from snapshot at /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Creating direct copy from snapshot {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc93e535-d204-4514-bd7a-bd706a48805a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:35 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d Sep 04 15:59:35 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:36 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d" returned: 0 in 0.488s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:36 devstack cinder-volume[87513]: DEBUG cinder.utils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Path /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4de25991-89d1-4a9c-b7f3-d950ffd94053 not found in is_blk_device check {{(pid=87513) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 04 15:59:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4de25991-89d1-4a9c-b7f3-d950ffd94053 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:36 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4de25991-89d1-4a9c-b7f3-d950ffd94053 Sep 04 15:59:36 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0f35d8ab-6bf2-4ef8-a286-0e1589635fe8 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Acquiring lock "cinder-183e6f06-98c1-47b3-a762-ffc21ed370f7-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0f35d8ab-6bf2-4ef8-a286-0e1589635fe8 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Lock "cinder-183e6f06-98c1-47b3-a762-ffc21ed370f7-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0f35d8ab-6bf2-4ef8-a286-0e1589635fe8 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Acquiring lock "cinder-quobyte-183e6f06-98c1-47b3-a762-ffc21ed370f7" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0f35d8ab-6bf2-4ef8-a286-0e1589635fe8 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Lock "cinder-quobyte-183e6f06-98c1-47b3-a762-ffc21ed370f7" acquired by "delete_volume" :: waited 0.032s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:38 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae521ad-0d3d-4a61-bdf9-f1b7750baacd]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0f35d8ab-6bf2-4ef8-a286-0e1589635fe8 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-183e6f06-98c1-47b3-a762-ffc21ed370f7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:38 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-183e6f06-98c1-47b3-a762-ffc21ed370f7 Sep 04 15:59:38 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:39 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0f35d8ab-6bf2-4ef8-a286-0e1589635fe8 tempest-VolumeQuotasNegativeTestJSON-412809410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-183e6f06-98c1-47b3-a762-ffc21ed370f7" returned: 0 in 0.803s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0f35d8ab-6bf2-4ef8-a286-0e1589635fe8 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-183e6f06-98c1-47b3-a762-ffc21ed370f7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:39 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-183e6f06-98c1-47b3-a762-ffc21ed370f7 Sep 04 15:59:39 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:40 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0f35d8ab-6bf2-4ef8-a286-0e1589635fe8 tempest-VolumeQuotasNegativeTestJSON-412809410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-183e6f06-98c1-47b3-a762-ffc21ed370f7" returned: 0 in 0.557s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0f35d8ab-6bf2-4ef8-a286-0e1589635fe8 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Lock "cinder-quobyte-183e6f06-98c1-47b3-a762-ffc21ed370f7" released by "delete_volume" :: held 1.491s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:40 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Flow 'volume_create_manager' (5484ec39-3cff-48e9-9d1a-c276ee25d3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7daeef-21f5-4317-b58a-70f9421a620e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7daeef-21f5-4317-b58a-70f9421a620e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-926632996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2534954d-7f7b-431e-9f04-dfbd672d5b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edcec05b9c564d47aec4cc98c2f3582f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:40Z,use_quota=True,user_id='611b9b221040463dbe745d6d3c6a542c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069f3372-fad2-4a11-b344-4bfc1120df3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069f3372-fad2-4a11-b344-4bfc1120df3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4f19b7-15fc-446b-96ad-9bb2938e124b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4f19b7-15fc-446b-96ad-9bb2938e124b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2534954d-7f7b-431e-9f04-dfbd672d5b7a', 'volume_name': 'volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854da95f-f1dd-4c19-acc1-e136bd222b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854da95f-f1dd-4c19-acc1-e136bd222b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7876da9-c800-4324-a6e9-f66a70125a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:40 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Volume 2534954d-7f7b-431e-9f04-dfbd672d5b7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a', 'volume_size': 1} Sep 04 15:59:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:40 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-0f35d8ab-6bf2-4ef8-a286-0e1589635fe8 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Created reservations ['b3888e55-3ac8-4a8b-a55c-a64a4089ad80', 'fd401b4a-9fc3-44b7-be6c-3f3ad9ad625d', '982a769f-4a2a-41c7-ba10-9cdb675f95b2', '74a00aa0-2d21-41b2-a471-26181c1d9be2'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0f35d8ab-6bf2-4ef8-a286-0e1589635fe8 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0f35d8ab-6bf2-4ef8-a286-0e1589635fe8 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0f35d8ab-6bf2-4ef8-a286-0e1589635fe8 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0f35d8ab-6bf2-4ef8-a286-0e1589635fe8 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0f35d8ab-6bf2-4ef8-a286-0e1589635fe8 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0f35d8ab-6bf2-4ef8-a286-0e1589635fe8 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:40 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:40 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:41 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0f35d8ab-6bf2-4ef8-a286-0e1589635fe8 tempest-VolumeQuotasNegativeTestJSON-412809410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 1.162s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:41 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-0f35d8ab-6bf2-4ef8-a286-0e1589635fe8 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:41 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-0f35d8ab-6bf2-4ef8-a286-0e1589635fe8 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Deleted volume successfully. Sep 04 15:59:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0f35d8ab-6bf2-4ef8-a286-0e1589635fe8 tempest-VolumeQuotasNegativeTestJSON-412809410 None] Lock "cinder-183e6f06-98c1-47b3-a762-ffc21ed370f7-delete_volume" released by "delete_volume" :: held 3.456s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:42 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4de25991-89d1-4a9c-b7f3-d950ffd94053" returned: 0 in 5.799s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9857e96e-53b7-4278-8d29-6c90777e9082]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Flow 'volume_create_manager' (de6f4a72-0d25-4f3a-bb20-6380312c303e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a369ee6e-1d85-4156-9aa3-536210125927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a369ee6e-1d85-4156-9aa3-536210125927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1825523359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d28cd0-0ebf-48fc-a3b3-add463755adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='281f957429b84273a1b4a2fa13195e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:42Z,use_quota=True,user_id='8a60646291e34fdd8d9f66e409955b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef62610c-eb3c-402b-9106-b3c4bbef4793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef62610c-eb3c-402b-9106-b3c4bbef4793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21a185a-efe7-4a53-8439-0c6b855b8658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21a185a-efe7-4a53-8439-0c6b855b8658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24d28cd0-0ebf-48fc-a3b3-add463755adb', 'volume_name': 'volume-24d28cd0-0ebf-48fc-a3b3-add463755adb', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba20d03c-3107-4a61-a80a-f380198e3e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba20d03c-3107-4a61-a80a-f380198e3e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f2a158-4125-4f30-96d5-cceb5f4ab1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:42 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Volume 24d28cd0-0ebf-48fc-a3b3-add463755adb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24d28cd0-0ebf-48fc-a3b3-add463755adb', 'volume_size': 1} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:42 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d Sep 04 15:59:42 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:42 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d" returned: 0 in 0.550s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Image conversion details: src /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4de25991-89d1-4a9c-b7f3-d950ffd94053 {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:59:42 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Converted 1024.00 MB image at 176.51 MB/s Sep 04 15:59:42 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4de25991-89d1-4a9c-b7f3-d950ffd94053 is being set with open permissions: ugo+rw Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4de25991-89d1-4a9c-b7f3-d950ffd94053 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:42 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4de25991-89d1-4a9c-b7f3-d950ffd94053 Sep 04 15:59:42 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:42 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4de25991-89d1-4a9c-b7f3-d950ffd94053" returned: 0 in 0.251s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Lock "cinder-quobyte-4de25991-89d1-4a9c-b7f3-d950ffd94053" released by "_copy_volume_from_snapshot" :: held 7.707s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Lock "cinder-quobyte-6a387760-a9a0-40e3-83dc-d6c39b071645-4de25991-89d1-4a9c-b7f3-d950ffd94053" released by "_create_volume_from_snapshot" :: held 7.788s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.837s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.416s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-926632996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2534954d-7f7b-431e-9f04-dfbd672d5b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edcec05b9c564d47aec4cc98c2f3582f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:40Z,use_quota=True,user_id='611b9b221040463dbe745d6d3c6a542c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Creating volume 2534954d-7f7b-431e-9f04-dfbd672d5b7a {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:59:42 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:42 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a 1073741824 Sep 04 15:59:42 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72238e7d-aa2c-4d95-844f-42a59894a8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de25991-89d1-4a9c-b7f3-d950ffd94053', 'volume_size': 1, 'snapshot_id': '6a387760-a9a0-40e3-83dc-d6c39b071645'}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c376ee-59bf-4a60-9751-bd8847dbad44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:42 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Volume volume-4de25991-89d1-4a9c-b7f3-d950ffd94053 (4de25991-89d1-4a9c-b7f3-d950ffd94053): created successfully Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c376ee-59bf-4a60-9751-bd8847dbad44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Flow 'volume_create_manager' (c18eb5f5-798b-4430-8b96-cc36b7f9d39a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:43 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b24a3e2e-d07e-4cae-9736-5d8e6b6d7e1e tempest-VolumeDependencyTests-2119845617 None] Created volume successfully. Sep 04 15:59:43 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a 1073741824" returned: 0 in 0.517s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:43 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a Sep 04 15:59:43 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:43 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a" returned: 0 in 0.264s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.564s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1825523359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d28cd0-0ebf-48fc-a3b3-add463755adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='281f957429b84273a1b4a2fa13195e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:42Z,use_quota=True,user_id='8a60646291e34fdd8d9f66e409955b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Creating volume 24d28cd0-0ebf-48fc-a3b3-add463755adb {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:59:43 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:59:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24d28cd0-0ebf-48fc-a3b3-add463755adb 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:43 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24d28cd0-0ebf-48fc-a3b3-add463755adb 1073741824 Sep 04 15:59:43 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:43 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7876da9-c800-4324-a6e9-f66a70125a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:43 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c986fc6-c6a9-427a-a977-0351f061f9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:43 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Volume volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a (2534954d-7f7b-431e-9f04-dfbd672d5b7a): created successfully Sep 04 15:59:43 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c986fc6-c6a9-427a-a977-0351f061f9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:43 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Flow 'volume_create_manager' (5484ec39-3cff-48e9-9d1a-c276ee25d3f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:43 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-087d43ab-25e2-4beb-9915-7330ee355f49 req-51f19eb4-8fc4-4a72-b498-883c811d0d9d tempest-VolumesSnapshotsTestJSON-2082197523 None] Created volume successfully. Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] Acquiring lock "cinder-6a387760-a9a0-40e3-83dc-d6c39b071645-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] Lock "cinder-6a387760-a9a0-40e3-83dc-d6c39b071645-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] Acquiring lock "cinder-quobyte-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] Lock "cinder-quobyte-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] Acquiring lock "cinder-quobyte-6a387760-a9a0-40e3-83dc-d6c39b071645" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] Lock "cinder-quobyte-6a387760-a9a0-40e3-83dc-d6c39b071645" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] Deleting offline snapshot 6a387760-a9a0-40e3-83dc-d6c39b071645 of volume 0f9f02d7-a650-4d92-b2d5-6fc73f91b68d {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] snapshot_file for this snap is: volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9387b8e2-cf16-41dc-8a59-906553f21b60]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:44 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24d28cd0-0ebf-48fc-a3b3-add463755adb 1073741824" returned: 0 in 0.564s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24d28cd0-0ebf-48fc-a3b3-add463755adb {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:44 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24d28cd0-0ebf-48fc-a3b3-add463755adb Sep 04 15:59:44 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:44 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645 Sep 04 15:59:44 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-0f8eecf6-c6d8-4810-9086-6844daaaa2e3 req-5aebccd5-83b4-4852-911b-b40fc22a2d13 tempest-VolumesSnapshotsTestJSON-2082197523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:44 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24d28cd0-0ebf-48fc-a3b3-add463755adb" returned: 0 in 0.319s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:44 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-0f8eecf6-c6d8-4810-9086-6844daaaa2e3 req-5aebccd5-83b4-4852-911b-b40fc22a2d13 tempest-VolumesSnapshotsTestJSON-2082197523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.276s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645" returned: 0 in 0.433s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [req-0f8eecf6-c6d8-4810-9086-6844daaaa2e3 req-5aebccd5-83b4-4852-911b-b40fc22a2d13 tempest-VolumesSnapshotsTestJSON-2082197523 None] Creating offline snapshot bb4fef27-fcc0-46db-ab52-d0b1201f4980 of volume 2534954d-7f7b-431e-9f04-dfbd672d5b7a {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a4e64a-8f81-47ea-b885-51da0e52394e]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f2a158-4125-4f30-96d5-cceb5f4ab1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24d28cd0-0ebf-48fc-a3b3-add463755adb', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2cb236a-b8f0-4fb1-a45d-8623e433d040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0109f270-83fe-4607-be6a-0426acc574c9]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-0f8eecf6-c6d8-4810-9086-6844daaaa2e3 req-5aebccd5-83b4-4852-911b-b40fc22a2d13 tempest-VolumesSnapshotsTestJSON-2082197523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:44 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Volume volume-24d28cd0-0ebf-48fc-a3b3-add463755adb (24d28cd0-0ebf-48fc-a3b3-add463755adb): created successfully Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2cb236a-b8f0-4fb1-a45d-8623e433d040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Flow 'volume_create_manager' (de6f4a72-0d25-4f3a-bb20-6380312c303e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:44 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b1f537ac-e13e-4ce5-aaa1-28fa1b3afa4b tempest-ProjectReaderTests-520506215 None] Created volume successfully. Sep 04 15:59:44 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a Sep 04 15:59:44 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:44 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d Sep 04 15:59:44 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:45 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-0f8eecf6-c6d8-4810-9086-6844daaaa2e3 req-5aebccd5-83b4-4852-911b-b40fc22a2d13 tempest-VolumesSnapshotsTestJSON-2082197523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a" returned: 0 in 0.398s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-0f8eecf6-c6d8-4810-9086-6844daaaa2e3 req-5aebccd5-83b4-4852-911b-b40fc22a2d13 tempest-VolumesSnapshotsTestJSON-2082197523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.bb4fef27-fcc0-46db-ab52-d0b1201f4980 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:45 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.bb4fef27-fcc0-46db-ab52-d0b1201f4980 1G Sep 04 15:59:45 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:45 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d" returned: 0 in 0.463s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:45 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645 Sep 04 15:59:45 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:45 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645" returned: 0 in 0.377s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:45 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645 Sep 04 15:59:45 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:45 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-0f8eecf6-c6d8-4810-9086-6844daaaa2e3 req-5aebccd5-83b4-4852-911b-b40fc22a2d13 tempest-VolumesSnapshotsTestJSON-2082197523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.bb4fef27-fcc0-46db-ab52-d0b1201f4980 1G" returned: 0 in 0.446s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-0f8eecf6-c6d8-4810-9086-6844daaaa2e3 req-5aebccd5-83b4-4852-911b-b40fc22a2d13 tempest-VolumesSnapshotsTestJSON-2082197523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.bb4fef27-fcc0-46db-ab52-d0b1201f4980 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:45 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.bb4fef27-fcc0-46db-ab52-d0b1201f4980 Sep 04 15:59:45 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f8564037-e638-41c0-9faa-299c18a5e056 tempest-ProjectReaderTests-520506215 None] Acquiring lock "cinder-24d28cd0-0ebf-48fc-a3b3-add463755adb-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f8564037-e638-41c0-9faa-299c18a5e056 tempest-ProjectReaderTests-520506215 None] Lock "cinder-24d28cd0-0ebf-48fc-a3b3-add463755adb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f8564037-e638-41c0-9faa-299c18a5e056 tempest-ProjectReaderTests-520506215 None] Acquiring lock "cinder-quobyte-24d28cd0-0ebf-48fc-a3b3-add463755adb" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f8564037-e638-41c0-9faa-299c18a5e056 tempest-ProjectReaderTests-520506215 None] Lock "cinder-quobyte-24d28cd0-0ebf-48fc-a3b3-add463755adb" acquired by "delete_volume" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:45 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3814140-7de2-44fe-b0db-d1e650ed4ac7]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f8564037-e638-41c0-9faa-299c18a5e056 tempest-ProjectReaderTests-520506215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24d28cd0-0ebf-48fc-a3b3-add463755adb {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:45 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d.6a387760-a9a0-40e3-83dc-d6c39b071645" returned: 0 in 0.329s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:45 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24d28cd0-0ebf-48fc-a3b3-add463755adb Sep 04 15:59:45 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] Lock "cinder-quobyte-6a387760-a9a0-40e3-83dc-d6c39b071645" released by "_delete_snapshot" :: held 1.743s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] Lock "cinder-quobyte-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d" released by "delete_snapshot" :: held 1.778s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:45 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-0f8eecf6-c6d8-4810-9086-6844daaaa2e3 req-5aebccd5-83b4-4852-911b-b40fc22a2d13 tempest-VolumesSnapshotsTestJSON-2082197523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.bb4fef27-fcc0-46db-ab52-d0b1201f4980" returned: 0 in 0.375s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:45 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [req-0f8eecf6-c6d8-4810-9086-6844daaaa2e3 req-5aebccd5-83b4-4852-911b-b40fc22a2d13 tempest-VolumesSnapshotsTestJSON-2082197523 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.bb4fef27-fcc0-46db-ab52-d0b1201f4980 is being set with open permissions: ugo+rw Sep 04 15:59:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-0f8eecf6-c6d8-4810-9086-6844daaaa2e3 req-5aebccd5-83b4-4852-911b-b40fc22a2d13 tempest-VolumesSnapshotsTestJSON-2082197523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.bb4fef27-fcc0-46db-ab52-d0b1201f4980 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:46 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.bb4fef27-fcc0-46db-ab52-d0b1201f4980 Sep 04 15:59:46 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] Created reservations ['768a2a45-7340-49f6-80c0-e9dcfadcfbfb', '1eaff5da-48a3-4f00-bfe2-b5583953f5b9', '677112f6-fa99-49b8-894b-ddb8ae2a78a5', '77441a8e-6d30-4c90-ac8a-91f0bc67ca23'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:46 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] Delete snapshot completed successfully. Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6e6edb7d-8e04-4733-8a5b-c4d839d00b15 tempest-VolumeDependencyTests-2119845617 None] Lock "cinder-6a387760-a9a0-40e3-83dc-d6c39b071645-delete_snapshot" released by "delete_snapshot" :: held 1.986s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:46 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f8564037-e638-41c0-9faa-299c18a5e056 tempest-ProjectReaderTests-520506215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24d28cd0-0ebf-48fc-a3b3-add463755adb" returned: 0 in 0.421s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f8564037-e638-41c0-9faa-299c18a5e056 tempest-ProjectReaderTests-520506215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24d28cd0-0ebf-48fc-a3b3-add463755adb {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:46 devstack sudo[100076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24d28cd0-0ebf-48fc-a3b3-add463755adb Sep 04 15:59:46 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:46 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-0f8eecf6-c6d8-4810-9086-6844daaaa2e3 req-5aebccd5-83b4-4852-911b-b40fc22a2d13 tempest-VolumesSnapshotsTestJSON-2082197523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.bb4fef27-fcc0-46db-ab52-d0b1201f4980" returned: 0 in 0.297s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-0f8eecf6-c6d8-4810-9086-6844daaaa2e3 req-5aebccd5-83b4-4852-911b-b40fc22a2d13 tempest-VolumesSnapshotsTestJSON-2082197523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:46 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.info Sep 04 15:59:46 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c6561bc1-8091-4427-93dc-9510bddf06c0 tempest-VolumeDependencyTests-2119845617 None] Acquiring lock "cinder-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c6561bc1-8091-4427-93dc-9510bddf06c0 tempest-VolumeDependencyTests-2119845617 None] Lock "cinder-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c6561bc1-8091-4427-93dc-9510bddf06c0 tempest-VolumeDependencyTests-2119845617 None] Acquiring lock "cinder-quobyte-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:46 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f8564037-e638-41c0-9faa-299c18a5e056 tempest-ProjectReaderTests-520506215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-24d28cd0-0ebf-48fc-a3b3-add463755adb" returned: 0 in 0.287s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f8564037-e638-41c0-9faa-299c18a5e056 tempest-ProjectReaderTests-520506215 None] Lock "cinder-quobyte-24d28cd0-0ebf-48fc-a3b3-add463755adb" released by "delete_volume" :: held 0.756s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c6561bc1-8091-4427-93dc-9510bddf06c0 tempest-VolumeDependencyTests-2119845617 None] Lock "cinder-quobyte-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d" acquired by "delete_volume" :: waited 0.031s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[350fab61-843c-43a7-96c7-9d4fd8c7b1c4]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c6561bc1-8091-4427-93dc-9510bddf06c0 tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-f8564037-e638-41c0-9faa-299c18a5e056 tempest-ProjectReaderTests-520506215 None] Created reservations ['b92b5cde-f940-4149-a0cd-ac417b3cba04', 'ec01fe76-9ad8-4e8b-8e54-d4ab291a4d56', '4120ac9a-4361-4ce6-90f4-551e29602c56', '800b3138-e994-4faf-99b5-6f804a8e5c2b'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:46 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-0f8eecf6-c6d8-4810-9086-6844daaaa2e3 req-5aebccd5-83b4-4852-911b-b40fc22a2d13 tempest-VolumesSnapshotsTestJSON-2082197523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.info" returned: 0 in 0.335s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:46 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [req-0f8eecf6-c6d8-4810-9086-6844daaaa2e3 req-5aebccd5-83b4-4852-911b-b40fc22a2d13 tempest-VolumesSnapshotsTestJSON-2082197523 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.info is being set with open permissions: ugo+rw Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-0f8eecf6-c6d8-4810-9086-6844daaaa2e3 req-5aebccd5-83b4-4852-911b-b40fc22a2d13 tempest-VolumesSnapshotsTestJSON-2082197523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:46 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d Sep 04 15:59:46 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.info Sep 04 15:59:46 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:46 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f8564037-e638-41c0-9faa-299c18a5e056 tempest-ProjectReaderTests-520506215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f8564037-e638-41c0-9faa-299c18a5e056 tempest-ProjectReaderTests-520506215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f8564037-e638-41c0-9faa-299c18a5e056 tempest-ProjectReaderTests-520506215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f8564037-e638-41c0-9faa-299c18a5e056 tempest-ProjectReaderTests-520506215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f8564037-e638-41c0-9faa-299c18a5e056 tempest-ProjectReaderTests-520506215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f8564037-e638-41c0-9faa-299c18a5e056 tempest-ProjectReaderTests-520506215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:46 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:46 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:47 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-0f8eecf6-c6d8-4810-9086-6844daaaa2e3 req-5aebccd5-83b4-4852-911b-b40fc22a2d13 tempest-VolumesSnapshotsTestJSON-2082197523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.info" returned: 0 in 0.353s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-0f8eecf6-c6d8-4810-9086-6844daaaa2e3 req-5aebccd5-83b4-4852-911b-b40fc22a2d13 tempest-VolumesSnapshotsTestJSON-2082197523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.393s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:47 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c6561bc1-8091-4427-93dc-9510bddf06c0 tempest-VolumeDependencyTests-2119845617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d" returned: 0 in 0.530s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c6561bc1-8091-4427-93dc-9510bddf06c0 tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:47 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f8564037-e638-41c0-9faa-299c18a5e056 tempest-ProjectReaderTests-520506215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.385s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-f8564037-e638-41c0-9faa-299c18a5e056 tempest-ProjectReaderTests-520506215 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:47 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-f8564037-e638-41c0-9faa-299c18a5e056 tempest-ProjectReaderTests-520506215 None] Deleted volume successfully. Sep 04 15:59:47 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d Sep 04 15:59:47 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-0f8eecf6-c6d8-4810-9086-6844daaaa2e3 req-5aebccd5-83b4-4852-911b-b40fc22a2d13 tempest-VolumesSnapshotsTestJSON-2082197523 None] Create snapshot completed successfully Sep 04 15:59:47 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f8564037-e638-41c0-9faa-299c18a5e056 tempest-ProjectReaderTests-520506215 None] Lock "cinder-24d28cd0-0ebf-48fc-a3b3-add463755adb-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:47 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c6561bc1-8091-4427-93dc-9510bddf06c0 tempest-VolumeDependencyTests-2119845617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d" returned: 0 in 0.273s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c6561bc1-8091-4427-93dc-9510bddf06c0 tempest-VolumeDependencyTests-2119845617 None] Lock "cinder-quobyte-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d" released by "delete_volume" :: held 0.864s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-c6561bc1-8091-4427-93dc-9510bddf06c0 tempest-VolumeDependencyTests-2119845617 None] Created reservations ['0904589c-9ba4-4120-ab6b-330a5c49bdfd', 'ef76732b-f21e-4f13-9f14-50c4fef2a5ba', '1a678751-8db8-4bd8-829c-f52bc849793a', 'e30b1b49-4ed9-4494-81ca-3b4546f59e42'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Flow 'volume_create_manager' (30511101-a669-40c8-84c0-0b4b5192eba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7efc586-93e2-4095-894b-6f45b163bc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7efc586-93e2-4095-894b-6f45b163bc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-830267100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b46938-8bdc-449b-8ad7-1504c17a3852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='281f957429b84273a1b4a2fa13195e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:47Z,use_quota=True,user_id='8a60646291e34fdd8d9f66e409955b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605e7055-68b4-4a7c-90ad-8b3f5f367804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605e7055-68b4-4a7c-90ad-8b3f5f367804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4cdf4b-6701-4c59-97b1-0f8cb1ea6214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4cdf4b-6701-4c59-97b1-0f8cb1ea6214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9b46938-8bdc-449b-8ad7-1504c17a3852', 'volume_name': 'volume-d9b46938-8bdc-449b-8ad7-1504c17a3852', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d6db26-e0b1-43da-8cda-726719b4ba9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d6db26-e0b1-43da-8cda-726719b4ba9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117c95fe-bca1-4da9-8111-d950fdb52308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:47 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Volume d9b46938-8bdc-449b-8ad7-1504c17a3852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9b46938-8bdc-449b-8ad7-1504c17a3852', 'volume_size': 1} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-830267100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b46938-8bdc-449b-8ad7-1504c17a3852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='281f957429b84273a1b4a2fa13195e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:47Z,use_quota=True,user_id='8a60646291e34fdd8d9f66e409955b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Creating volume d9b46938-8bdc-449b-8ad7-1504c17a3852 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:59:47 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d9b46938-8bdc-449b-8ad7-1504c17a3852 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e01932b8-95b7-44d2-9fa4-c738733a3ab3 tempest-VolumeDependencyTests-2119845617 None] Acquiring lock "cinder-4de25991-89d1-4a9c-b7f3-d950ffd94053-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:47 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d9b46938-8bdc-449b-8ad7-1504c17a3852 1073741824 Sep 04 15:59:47 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e01932b8-95b7-44d2-9fa4-c738733a3ab3 tempest-VolumeDependencyTests-2119845617 None] Lock "cinder-4de25991-89d1-4a9c-b7f3-d950ffd94053-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c6561bc1-8091-4427-93dc-9510bddf06c0 tempest-VolumeDependencyTests-2119845617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c6561bc1-8091-4427-93dc-9510bddf06c0 tempest-VolumeDependencyTests-2119845617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c6561bc1-8091-4427-93dc-9510bddf06c0 tempest-VolumeDependencyTests-2119845617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c6561bc1-8091-4427-93dc-9510bddf06c0 tempest-VolumeDependencyTests-2119845617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c6561bc1-8091-4427-93dc-9510bddf06c0 tempest-VolumeDependencyTests-2119845617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c6561bc1-8091-4427-93dc-9510bddf06c0 tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e01932b8-95b7-44d2-9fa4-c738733a3ab3 tempest-VolumeDependencyTests-2119845617 None] Acquiring lock "cinder-quobyte-4de25991-89d1-4a9c-b7f3-d950ffd94053" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e01932b8-95b7-44d2-9fa4-c738733a3ab3 tempest-VolumeDependencyTests-2119845617 None] Lock "cinder-quobyte-4de25991-89d1-4a9c-b7f3-d950ffd94053" acquired by "delete_volume" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:47 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:47 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e87fe7-e188-4b41-b1e6-689fc4c8eed0]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e01932b8-95b7-44d2-9fa4-c738733a3ab3 tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4de25991-89d1-4a9c-b7f3-d950ffd94053 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:47 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4de25991-89d1-4a9c-b7f3-d950ffd94053 Sep 04 15:59:47 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:48 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c6561bc1-8091-4427-93dc-9510bddf06c0 tempest-VolumeDependencyTests-2119845617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.327s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-c6561bc1-8091-4427-93dc-9510bddf06c0 tempest-VolumeDependencyTests-2119845617 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:48 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-c6561bc1-8091-4427-93dc-9510bddf06c0 tempest-VolumeDependencyTests-2119845617 None] Deleted volume successfully. Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c6561bc1-8091-4427-93dc-9510bddf06c0 tempest-VolumeDependencyTests-2119845617 None] Lock "cinder-0f9f02d7-a650-4d92-b2d5-6fc73f91b68d-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:48 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d9b46938-8bdc-449b-8ad7-1504c17a3852 1073741824" returned: 0 in 0.655s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:48 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] Acquiring lock "cinder-bb4fef27-fcc0-46db-ab52-d0b1201f4980-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e01932b8-95b7-44d2-9fa4-c738733a3ab3 tempest-VolumeDependencyTests-2119845617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4de25991-89d1-4a9c-b7f3-d950ffd94053" returned: 0 in 0.513s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e01932b8-95b7-44d2-9fa4-c738733a3ab3 tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4de25991-89d1-4a9c-b7f3-d950ffd94053 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] Lock "cinder-bb4fef27-fcc0-46db-ab52-d0b1201f4980-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] Acquiring lock "cinder-quobyte-2534954d-7f7b-431e-9f04-dfbd672d5b7a" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:48 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4de25991-89d1-4a9c-b7f3-d950ffd94053 Sep 04 15:59:48 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d9b46938-8bdc-449b-8ad7-1504c17a3852 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] Lock "cinder-quobyte-2534954d-7f7b-431e-9f04-dfbd672d5b7a" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] Acquiring lock "cinder-quobyte-bb4fef27-fcc0-46db-ab52-d0b1201f4980" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:48 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d9b46938-8bdc-449b-8ad7-1504c17a3852 Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:48 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Flow 'volume_create_manager' (e2b09013-3b15-4329-af3b-a4f09d2340bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94cb1918-2ea2-4041-8a5f-443dd9d88411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94cb1918-2ea2-4041-8a5f-443dd9d88411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1660235954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0824b9-e3c8-415c-b34a-b9e3978bb4f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe545a966964604b39571617788b60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:48Z,use_quota=True,user_id='90ee6932ea6b429dae42dc4c72453a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df87373-cff3-45cf-be15-efd49d7899ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df87373-cff3-45cf-be15-efd49d7899ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d70aa0-b694-4390-9659-3422f9437946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d70aa0-b694-4390-9659-3422f9437946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a0824b9-e3c8-415c-b34a-b9e3978bb4f1', 'volume_name': 'volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56cd6cde-e923-4908-9ff2-15d6ac1013df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56cd6cde-e923-4908-9ff2-15d6ac1013df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd19d549-dbea-4b3f-8b04-aa072f436cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:48 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Volume 8a0824b9-e3c8-415c-b34a-b9e3978bb4f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1', 'volume_size': 1} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] Lock "cinder-quobyte-bb4fef27-fcc0-46db-ab52-d0b1201f4980" acquired by "_delete_snapshot" :: waited 0.092s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] Deleting offline snapshot bb4fef27-fcc0-46db-ab52-d0b1201f4980 of volume 2534954d-7f7b-431e-9f04-dfbd672d5b7a {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] snapshot_file for this snap is: volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.bb4fef27-fcc0-46db-ab52-d0b1201f4980 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb761e96-1c9a-4bbd-9c58-14d62258942e]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.bb4fef27-fcc0-46db-ab52-d0b1201f4980 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:48 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e01932b8-95b7-44d2-9fa4-c738733a3ab3 tempest-VolumeDependencyTests-2119845617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4de25991-89d1-4a9c-b7f3-d950ffd94053" returned: 0 in 0.268s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e01932b8-95b7-44d2-9fa4-c738733a3ab3 tempest-VolumeDependencyTests-2119845617 None] Lock "cinder-quobyte-4de25991-89d1-4a9c-b7f3-d950ffd94053" released by "delete_volume" :: held 0.831s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:48 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.bb4fef27-fcc0-46db-ab52-d0b1201f4980 Sep 04 15:59:48 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-e01932b8-95b7-44d2-9fa4-c738733a3ab3 tempest-VolumeDependencyTests-2119845617 None] Created reservations ['f1783984-b475-4e9d-b9c9-2c341fee0097', '96d9e189-eea9-41ff-9ac4-cd76f006300d', '733819c5-85b7-4272-ac63-d38a408a42c8', '2b56ae9d-caf2-4c92-a1ae-552f6e9a40da'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:48 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d9b46938-8bdc-449b-8ad7-1504c17a3852" returned: 0 in 0.295s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.174s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1660235954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0824b9-e3c8-415c-b34a-b9e3978bb4f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe545a966964604b39571617788b60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:48Z,use_quota=True,user_id='90ee6932ea6b429dae42dc4c72453a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Creating volume 8a0824b9-e3c8-415c-b34a-b9e3978bb4f1 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:59:48 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:48 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1 1073741824 Sep 04 15:59:48 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117c95fe-bca1-4da9-8111-d950fdb52308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9b46938-8bdc-449b-8ad7-1504c17a3852', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e99af7-217f-4f2c-a88e-7d628b1c398b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:48 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Volume volume-d9b46938-8bdc-449b-8ad7-1504c17a3852 (d9b46938-8bdc-449b-8ad7-1504c17a3852): created successfully Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e99af7-217f-4f2c-a88e-7d628b1c398b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Flow 'volume_create_manager' (30511101-a669-40c8-84c0-0b4b5192eba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:48 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-c46af8a5-1251-42e9-ac36-dde7a2442c23 tempest-ProjectReaderTests-520506215 None] Created volume successfully. Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e01932b8-95b7-44d2-9fa4-c738733a3ab3 tempest-VolumeDependencyTests-2119845617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e01932b8-95b7-44d2-9fa4-c738733a3ab3 tempest-VolumeDependencyTests-2119845617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e01932b8-95b7-44d2-9fa4-c738733a3ab3 tempest-VolumeDependencyTests-2119845617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e01932b8-95b7-44d2-9fa4-c738733a3ab3 tempest-VolumeDependencyTests-2119845617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e01932b8-95b7-44d2-9fa4-c738733a3ab3 tempest-VolumeDependencyTests-2119845617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e01932b8-95b7-44d2-9fa4-c738733a3ab3 tempest-VolumeDependencyTests-2119845617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:48 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:48 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:48 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.bb4fef27-fcc0-46db-ab52-d0b1201f4980" returned: 0 in 0.407s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c03886-95ad-40df-a030-7cfa8ae38d8b]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:49 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e01932b8-95b7-44d2-9fa4-c738733a3ab3 tempest-VolumeDependencyTests-2119845617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.300s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-e01932b8-95b7-44d2-9fa4-c738733a3ab3 tempest-VolumeDependencyTests-2119845617 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:49 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e01932b8-95b7-44d2-9fa4-c738733a3ab3 tempest-VolumeDependencyTests-2119845617 None] Deleted volume successfully. Sep 04 15:59:49 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a Sep 04 15:59:49 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e01932b8-95b7-44d2-9fa4-c738733a3ab3 tempest-VolumeDependencyTests-2119845617 None] Lock "cinder-4de25991-89d1-4a9c-b7f3-d950ffd94053-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:49 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1 1073741824" returned: 0 in 0.613s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:49 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1 Sep 04 15:59:49 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:49 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a" returned: 0 in 0.477s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.bb4fef27-fcc0-46db-ab52-d0b1201f4980 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:49 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.bb4fef27-fcc0-46db-ab52-d0b1201f4980 Sep 04 15:59:49 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:49 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1" returned: 0 in 0.298s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd19d549-dbea-4b3f-8b04-aa072f436cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c71ae7b-eaad-4a4b-8563-2ca675f31b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a0aa9414-0f07-40a9-a853-63fa164b9a48 tempest-ProjectReaderTests-520506215 None] Acquiring lock "cinder-d9b46938-8bdc-449b-8ad7-1504c17a3852-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:49 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Volume volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1 (8a0824b9-e3c8-415c-b34a-b9e3978bb4f1): created successfully Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c71ae7b-eaad-4a4b-8563-2ca675f31b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Flow 'volume_create_manager' (e2b09013-3b15-4329-af3b-a4f09d2340bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a0aa9414-0f07-40a9-a853-63fa164b9a48 tempest-ProjectReaderTests-520506215 None] Lock "cinder-d9b46938-8bdc-449b-8ad7-1504c17a3852-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:49 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-9db2e7fe-8b1d-4b89-8c8b-9c8272f8ef43 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Created volume successfully. Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a0aa9414-0f07-40a9-a853-63fa164b9a48 tempest-ProjectReaderTests-520506215 None] Acquiring lock "cinder-quobyte-d9b46938-8bdc-449b-8ad7-1504c17a3852" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a0aa9414-0f07-40a9-a853-63fa164b9a48 tempest-ProjectReaderTests-520506215 None] Lock "cinder-quobyte-d9b46938-8bdc-449b-8ad7-1504c17a3852" acquired by "delete_volume" :: waited 0.022s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f8b411-a775-4777-8ffc-fcae09424df9]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a0aa9414-0f07-40a9-a853-63fa164b9a48 tempest-ProjectReaderTests-520506215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d9b46938-8bdc-449b-8ad7-1504c17a3852 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:49 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.bb4fef27-fcc0-46db-ab52-d0b1201f4980" returned: 0 in 0.481s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.bb4fef27-fcc0-46db-ab52-d0b1201f4980 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:49 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d9b46938-8bdc-449b-8ad7-1504c17a3852 Sep 04 15:59:49 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:49 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.bb4fef27-fcc0-46db-ab52-d0b1201f4980 Sep 04 15:59:49 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:50 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a.bb4fef27-fcc0-46db-ab52-d0b1201f4980" returned: 0 in 0.275s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:50 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a0aa9414-0f07-40a9-a853-63fa164b9a48 tempest-ProjectReaderTests-520506215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d9b46938-8bdc-449b-8ad7-1504c17a3852" returned: 0 in 0.411s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a0aa9414-0f07-40a9-a853-63fa164b9a48 tempest-ProjectReaderTests-520506215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d9b46938-8bdc-449b-8ad7-1504c17a3852 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] Lock "cinder-quobyte-bb4fef27-fcc0-46db-ab52-d0b1201f4980" released by "_delete_snapshot" :: held 1.777s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] Lock "cinder-quobyte-2534954d-7f7b-431e-9f04-dfbd672d5b7a" released by "delete_snapshot" :: held 1.881s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:50 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d9b46938-8bdc-449b-8ad7-1504c17a3852 Sep 04 15:59:50 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG cinder.quota [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] Created reservations ['ef160147-5b24-4b3a-8743-e059445b38f7', '3e474812-9351-4363-b95d-493a7b52e69b', '0011cac8-90bf-4a6e-ae0c-9b9d5b8d503e', '6cb0434c-50ea-4fd5-a8f3-6a2c0eaea8b4'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:50 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] Delete snapshot completed successfully. Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-e9de7f9f-a6fb-4a71-8102-60710230c9b9 req-8be8ee2f-59e1-4b86-94b6-82aac7550d44 tempest-VolumesSnapshotsTestJSON-2082197523 None] Lock "cinder-bb4fef27-fcc0-46db-ab52-d0b1201f4980-delete_snapshot" released by "delete_snapshot" :: held 2.130s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:50 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-c548718e-2f4b-448f-abff-b695f245da35 req-a0cc25fd-2a53-4b10-b261-622cd9927a0e tempest-VolumesSnapshotsTestJSON-2082197523 None] Acquiring lock "cinder-2534954d-7f7b-431e-9f04-dfbd672d5b7a-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a0aa9414-0f07-40a9-a853-63fa164b9a48 tempest-ProjectReaderTests-520506215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d9b46938-8bdc-449b-8ad7-1504c17a3852" returned: 0 in 0.365s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a0aa9414-0f07-40a9-a853-63fa164b9a48 tempest-ProjectReaderTests-520506215 None] Lock "cinder-quobyte-d9b46938-8bdc-449b-8ad7-1504c17a3852" released by "delete_volume" :: held 0.842s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-c548718e-2f4b-448f-abff-b695f245da35 req-a0cc25fd-2a53-4b10-b261-622cd9927a0e tempest-VolumesSnapshotsTestJSON-2082197523 None] Lock "cinder-2534954d-7f7b-431e-9f04-dfbd672d5b7a-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-c548718e-2f4b-448f-abff-b695f245da35 req-a0cc25fd-2a53-4b10-b261-622cd9927a0e tempest-VolumesSnapshotsTestJSON-2082197523 None] Acquiring lock "cinder-quobyte-2534954d-7f7b-431e-9f04-dfbd672d5b7a" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dbb0bd28-4c35-4d2b-a6c0-8b0ff7fda1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dbb0bd28-4c35-4d2b-a6c0-8b0ff7fda1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-c548718e-2f4b-448f-abff-b695f245da35 req-a0cc25fd-2a53-4b10-b261-622cd9927a0e tempest-VolumesSnapshotsTestJSON-2082197523 None] Lock "cinder-quobyte-2534954d-7f7b-431e-9f04-dfbd672d5b7a" acquired by "delete_volume" :: waited 0.033s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-dbb0bd28-4c35-4d2b-a6c0-8b0ff7fda1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Creating offline snapshot e4ca209d-d3b4-4b51-8238-1f18123f34f4 of volume 8a0824b9-e3c8-415c-b34a-b9e3978bb4f1 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d439f63c-24a9-4a46-a02a-2b2f089ace3f]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-c548718e-2f4b-448f-abff-b695f245da35 req-a0cc25fd-2a53-4b10-b261-622cd9927a0e tempest-VolumesSnapshotsTestJSON-2082197523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ef64b7-4582-4722-82e7-f9f0f02024e1]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-a0aa9414-0f07-40a9-a853-63fa164b9a48 tempest-ProjectReaderTests-520506215 None] Created reservations ['55c952f4-8c1b-4205-a4ef-9e75fe37ceb1', '8655d1b3-309b-4af5-869e-265092d1bc53', '03b9318a-7fbc-4825-9333-1c9673189ac7', '09398f14-2371-4334-b8d5-e58d2bb97947'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dbb0bd28-4c35-4d2b-a6c0-8b0ff7fda1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a0aa9414-0f07-40a9-a853-63fa164b9a48 tempest-ProjectReaderTests-520506215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a0aa9414-0f07-40a9-a853-63fa164b9a48 tempest-ProjectReaderTests-520506215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a0aa9414-0f07-40a9-a853-63fa164b9a48 tempest-ProjectReaderTests-520506215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a0aa9414-0f07-40a9-a853-63fa164b9a48 tempest-ProjectReaderTests-520506215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a0aa9414-0f07-40a9-a853-63fa164b9a48 tempest-ProjectReaderTests-520506215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a0aa9414-0f07-40a9-a853-63fa164b9a48 tempest-ProjectReaderTests-520506215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:50 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:50 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:50 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1 Sep 04 15:59:50 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:50 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a Sep 04 15:59:50 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:51 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a0aa9414-0f07-40a9-a853-63fa164b9a48 tempest-ProjectReaderTests-520506215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.264s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:51 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-a0aa9414-0f07-40a9-a853-63fa164b9a48 tempest-ProjectReaderTests-520506215 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:51 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-a0aa9414-0f07-40a9-a853-63fa164b9a48 tempest-ProjectReaderTests-520506215 None] Deleted volume successfully. Sep 04 15:59:51 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a0aa9414-0f07-40a9-a853-63fa164b9a48 tempest-ProjectReaderTests-520506215 None] Lock "cinder-d9b46938-8bdc-449b-8ad7-1504c17a3852-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:51 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dbb0bd28-4c35-4d2b-a6c0-8b0ff7fda1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1" returned: 0 in 0.430s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dbb0bd28-4c35-4d2b-a6c0-8b0ff7fda1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.e4ca209d-d3b4-4b51-8238-1f18123f34f4 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:51 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-c548718e-2f4b-448f-abff-b695f245da35 req-a0cc25fd-2a53-4b10-b261-622cd9927a0e tempest-VolumesSnapshotsTestJSON-2082197523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a" returned: 0 in 0.472s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-c548718e-2f4b-448f-abff-b695f245da35 req-a0cc25fd-2a53-4b10-b261-622cd9927a0e tempest-VolumesSnapshotsTestJSON-2082197523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:51 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.e4ca209d-d3b4-4b51-8238-1f18123f34f4 1G Sep 04 15:59:51 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:51 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a Sep 04 15:59:51 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:51 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-c548718e-2f4b-448f-abff-b695f245da35 req-a0cc25fd-2a53-4b10-b261-622cd9927a0e tempest-VolumesSnapshotsTestJSON-2082197523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2534954d-7f7b-431e-9f04-dfbd672d5b7a" returned: 0 in 0.252s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:51 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-c548718e-2f4b-448f-abff-b695f245da35 req-a0cc25fd-2a53-4b10-b261-622cd9927a0e tempest-VolumesSnapshotsTestJSON-2082197523 None] Lock "cinder-quobyte-2534954d-7f7b-431e-9f04-dfbd672d5b7a" released by "delete_volume" :: held 0.810s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:51 devstack cinder-volume[87513]: DEBUG cinder.quota [req-c548718e-2f4b-448f-abff-b695f245da35 req-a0cc25fd-2a53-4b10-b261-622cd9927a0e tempest-VolumesSnapshotsTestJSON-2082197523 None] Created reservations ['dd1c7c18-adaf-41ba-b42c-fe03e24704ab', '997847df-1a64-408f-b35d-1e02c47c4927', '13081959-8e67-4139-ab91-6874721d9fee', 'c9525629-6200-4f28-b6bf-41b41d7b5d4a'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-c548718e-2f4b-448f-abff-b695f245da35 req-a0cc25fd-2a53-4b10-b261-622cd9927a0e tempest-VolumesSnapshotsTestJSON-2082197523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-c548718e-2f4b-448f-abff-b695f245da35 req-a0cc25fd-2a53-4b10-b261-622cd9927a0e tempest-VolumesSnapshotsTestJSON-2082197523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [req-c548718e-2f4b-448f-abff-b695f245da35 req-a0cc25fd-2a53-4b10-b261-622cd9927a0e tempest-VolumesSnapshotsTestJSON-2082197523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [req-c548718e-2f4b-448f-abff-b695f245da35 req-a0cc25fd-2a53-4b10-b261-622cd9927a0e tempest-VolumesSnapshotsTestJSON-2082197523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-c548718e-2f4b-448f-abff-b695f245da35 req-a0cc25fd-2a53-4b10-b261-622cd9927a0e tempest-VolumesSnapshotsTestJSON-2082197523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-c548718e-2f4b-448f-abff-b695f245da35 req-a0cc25fd-2a53-4b10-b261-622cd9927a0e tempest-VolumesSnapshotsTestJSON-2082197523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:51 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dbb0bd28-4c35-4d2b-a6c0-8b0ff7fda1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.e4ca209d-d3b4-4b51-8238-1f18123f34f4 1G" returned: 0 in 0.458s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dbb0bd28-4c35-4d2b-a6c0-8b0ff7fda1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.e4ca209d-d3b4-4b51-8238-1f18123f34f4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:51 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:51 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:51 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.e4ca209d-d3b4-4b51-8238-1f18123f34f4 Sep 04 15:59:51 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:52 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-c548718e-2f4b-448f-abff-b695f245da35 req-a0cc25fd-2a53-4b10-b261-622cd9927a0e tempest-VolumesSnapshotsTestJSON-2082197523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.295s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:52 devstack cinder-volume[87513]: DEBUG cinder.manager [req-c548718e-2f4b-448f-abff-b695f245da35 req-a0cc25fd-2a53-4b10-b261-622cd9927a0e tempest-VolumesSnapshotsTestJSON-2082197523 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:52 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-c548718e-2f4b-448f-abff-b695f245da35 req-a0cc25fd-2a53-4b10-b261-622cd9927a0e tempest-VolumesSnapshotsTestJSON-2082197523 None] Deleted volume successfully. Sep 04 15:59:52 devstack cinder-volume[87513]: DEBUG cinder.coordination [req-c548718e-2f4b-448f-abff-b695f245da35 req-a0cc25fd-2a53-4b10-b261-622cd9927a0e tempest-VolumesSnapshotsTestJSON-2082197523 None] Lock "cinder-2534954d-7f7b-431e-9f04-dfbd672d5b7a-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:52 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dbb0bd28-4c35-4d2b-a6c0-8b0ff7fda1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.e4ca209d-d3b4-4b51-8238-1f18123f34f4" returned: 0 in 0.429s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:52 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-dbb0bd28-4c35-4d2b-a6c0-8b0ff7fda1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.e4ca209d-d3b4-4b51-8238-1f18123f34f4 is being set with open permissions: ugo+rw Sep 04 15:59:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dbb0bd28-4c35-4d2b-a6c0-8b0ff7fda1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.e4ca209d-d3b4-4b51-8238-1f18123f34f4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:52 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.e4ca209d-d3b4-4b51-8238-1f18123f34f4 Sep 04 15:59:52 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:52 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:52 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Flow 'volume_create_manager' (37954f5d-ec30-4da7-a7a4-f366f0de9141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52eeb307-fa5f-4b8d-a398-a01b9768741a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dbb0bd28-4c35-4d2b-a6c0-8b0ff7fda1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.e4ca209d-d3b4-4b51-8238-1f18123f34f4" returned: 0 in 0.408s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52eeb307-fa5f-4b8d-a398-a01b9768741a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1497752414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b9302e-de6a-44d4-a08f-5e24cc7a99a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='281f957429b84273a1b4a2fa13195e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:52Z,use_quota=True,user_id='8a60646291e34fdd8d9f66e409955b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06be1f87-e06a-4335-b4dd-e65ae46996fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06be1f87-e06a-4335-b4dd-e65ae46996fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c005f0c1-2a08-4a1d-a8ca-21634e0f15d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c005f0c1-2a08-4a1d-a8ca-21634e0f15d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09b9302e-de6a-44d4-a08f-5e24cc7a99a4', 'volume_name': 'volume-09b9302e-de6a-44d4-a08f-5e24cc7a99a4', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfc56e3-9a91-46e5-940e-6c8aa9bdc401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfc56e3-9a91-46e5-940e-6c8aa9bdc401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d2d875-848d-4f2a-a991-d2e731f82664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:52 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Volume 09b9302e-de6a-44d4-a08f-5e24cc7a99a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09b9302e-de6a-44d4-a08f-5e24cc7a99a4', 'volume_size': 1} Sep 04 15:59:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dbb0bd28-4c35-4d2b-a6c0-8b0ff7fda1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:52 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.info Sep 04 15:59:52 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:52 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dbb0bd28-4c35-4d2b-a6c0-8b0ff7fda1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.info" returned: 0 in 0.261s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:52 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-dbb0bd28-4c35-4d2b-a6c0-8b0ff7fda1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.info is being set with open permissions: ugo+rw Sep 04 15:59:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dbb0bd28-4c35-4d2b-a6c0-8b0ff7fda1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:52 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.info Sep 04 15:59:52 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:53 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dbb0bd28-4c35-4d2b-a6c0-8b0ff7fda1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.info" returned: 0 in 0.270s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dbb0bd28-4c35-4d2b-a6c0-8b0ff7fda1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.481s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.578s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:53 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1497752414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b9302e-de6a-44d4-a08f-5e24cc7a99a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='281f957429b84273a1b4a2fa13195e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:52Z,use_quota=True,user_id='8a60646291e34fdd8d9f66e409955b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:53 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Creating volume 09b9302e-de6a-44d4-a08f-5e24cc7a99a4 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:53 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:53 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:53 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:59:53 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:59:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09b9302e-de6a-44d4-a08f-5e24cc7a99a4 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:53 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09b9302e-de6a-44d4-a08f-5e24cc7a99a4 1073741824 Sep 04 15:59:53 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:53 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-dbb0bd28-4c35-4d2b-a6c0-8b0ff7fda1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Create snapshot completed successfully Sep 04 15:59:53 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09b9302e-de6a-44d4-a08f-5e24cc7a99a4 1073741824" returned: 0 in 0.452s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09b9302e-de6a-44d4-a08f-5e24cc7a99a4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:53 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09b9302e-de6a-44d4-a08f-5e24cc7a99a4 Sep 04 15:59:53 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:54 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09b9302e-de6a-44d4-a08f-5e24cc7a99a4" returned: 0 in 0.285s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d2d875-848d-4f2a-a991-d2e731f82664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09b9302e-de6a-44d4-a08f-5e24cc7a99a4', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c84ec0b-3b58-40b3-bcab-ad77a340b638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:54 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Volume volume-09b9302e-de6a-44d4-a08f-5e24cc7a99a4 (09b9302e-de6a-44d4-a08f-5e24cc7a99a4): created successfully Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c84ec0b-3b58-40b3-bcab-ad77a340b638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Flow 'volume_create_manager' (37954f5d-ec30-4da7-a7a4-f366f0de9141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:54 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-1a17683c-81d1-4ea5-b7d5-92e4e4b164f5 tempest-ProjectReaderTests-520506215 None] Created volume successfully. Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Acquiring lock "cinder-e4ca209d-d3b4-4b51-8238-1f18123f34f4-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Lock "cinder-e4ca209d-d3b4-4b51-8238-1f18123f34f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Acquiring lock "cinder-quobyte-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Lock "cinder-quobyte-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Acquiring lock "cinder-quobyte-e4ca209d-d3b4-4b51-8238-1f18123f34f4" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Lock "cinder-quobyte-e4ca209d-d3b4-4b51-8238-1f18123f34f4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Deleting offline snapshot e4ca209d-d3b4-4b51-8238-1f18123f34f4 of volume 8a0824b9-e3c8-415c-b34a-b9e3978bb4f1 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] snapshot_file for this snap is: volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.e4ca209d-d3b4-4b51-8238-1f18123f34f4 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fd19ca-f5c3-4401-ad58-865a9c9d92cc]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.e4ca209d-d3b4-4b51-8238-1f18123f34f4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:54 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.e4ca209d-d3b4-4b51-8238-1f18123f34f4 Sep 04 15:59:54 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-361f5c42-af80-4ed3-abde-58bda3698b24 tempest-ProjectReaderTests-520506215 None] Acquiring lock "cinder-09b9302e-de6a-44d4-a08f-5e24cc7a99a4-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-361f5c42-af80-4ed3-abde-58bda3698b24 tempest-ProjectReaderTests-520506215 None] Lock "cinder-09b9302e-de6a-44d4-a08f-5e24cc7a99a4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-361f5c42-af80-4ed3-abde-58bda3698b24 tempest-ProjectReaderTests-520506215 None] Acquiring lock "cinder-quobyte-09b9302e-de6a-44d4-a08f-5e24cc7a99a4" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-361f5c42-af80-4ed3-abde-58bda3698b24 tempest-ProjectReaderTests-520506215 None] Lock "cinder-quobyte-09b9302e-de6a-44d4-a08f-5e24cc7a99a4" acquired by "delete_volume" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e8c4f2-4b64-4b30-9e42-f306043202cf]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-361f5c42-af80-4ed3-abde-58bda3698b24 tempest-ProjectReaderTests-520506215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09b9302e-de6a-44d4-a08f-5e24cc7a99a4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:54 devstack sudo[100212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09b9302e-de6a-44d4-a08f-5e24cc7a99a4 Sep 04 15:59:54 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:54 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.e4ca209d-d3b4-4b51-8238-1f18123f34f4" returned: 0 in 0.427s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:54 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:59:55 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[4483e484-9a8c-4a7d-9052-5f4070ca2c49]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:55 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1 Sep 04 15:59:55 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:55 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-361f5c42-af80-4ed3-abde-58bda3698b24 tempest-ProjectReaderTests-520506215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09b9302e-de6a-44d4-a08f-5e24cc7a99a4" returned: 0 in 0.442s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-361f5c42-af80-4ed3-abde-58bda3698b24 tempest-ProjectReaderTests-520506215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09b9302e-de6a-44d4-a08f-5e24cc7a99a4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:55 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09b9302e-de6a-44d4-a08f-5e24cc7a99a4 Sep 04 15:59:55 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:55 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1" returned: 0 in 0.440s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.e4ca209d-d3b4-4b51-8238-1f18123f34f4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:55 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.e4ca209d-d3b4-4b51-8238-1f18123f34f4 Sep 04 15:59:55 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:55 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-361f5c42-af80-4ed3-abde-58bda3698b24 tempest-ProjectReaderTests-520506215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09b9302e-de6a-44d4-a08f-5e24cc7a99a4" returned: 0 in 0.267s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-361f5c42-af80-4ed3-abde-58bda3698b24 tempest-ProjectReaderTests-520506215 None] Lock "cinder-quobyte-09b9302e-de6a-44d4-a08f-5e24cc7a99a4" released by "delete_volume" :: held 0.754s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:55 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-361f5c42-af80-4ed3-abde-58bda3698b24 tempest-ProjectReaderTests-520506215 None] Created reservations ['0511cb45-08b2-4cc5-9883-8bfeca37baad', '1b635a72-22bf-4b23-94c2-dbb6f34b78a4', 'c19e0957-bb3c-4c6c-9ea9-dccb81effa6f', '70821372-8292-4a9b-88af-cc5d7ff2c7e1'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-361f5c42-af80-4ed3-abde-58bda3698b24 tempest-ProjectReaderTests-520506215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-361f5c42-af80-4ed3-abde-58bda3698b24 tempest-ProjectReaderTests-520506215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-361f5c42-af80-4ed3-abde-58bda3698b24 tempest-ProjectReaderTests-520506215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-361f5c42-af80-4ed3-abde-58bda3698b24 tempest-ProjectReaderTests-520506215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-361f5c42-af80-4ed3-abde-58bda3698b24 tempest-ProjectReaderTests-520506215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-361f5c42-af80-4ed3-abde-58bda3698b24 tempest-ProjectReaderTests-520506215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:55 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:55 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:55 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.e4ca209d-d3b4-4b51-8238-1f18123f34f4" returned: 0 in 0.392s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.e4ca209d-d3b4-4b51-8238-1f18123f34f4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:55 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.e4ca209d-d3b4-4b51-8238-1f18123f34f4 Sep 04 15:59:55 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:55 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-361f5c42-af80-4ed3-abde-58bda3698b24 tempest-ProjectReaderTests-520506215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.284s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:55 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-361f5c42-af80-4ed3-abde-58bda3698b24 tempest-ProjectReaderTests-520506215 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:55 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-361f5c42-af80-4ed3-abde-58bda3698b24 tempest-ProjectReaderTests-520506215 None] Deleted volume successfully. Sep 04 15:59:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-361f5c42-af80-4ed3-abde-58bda3698b24 tempest-ProjectReaderTests-520506215 None] Lock "cinder-09b9302e-de6a-44d4-a08f-5e24cc7a99a4-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:56 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1.e4ca209d-d3b4-4b51-8238-1f18123f34f4" returned: 0 in 0.281s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b69e0fc7-270f-4967-be8b-eb26f828d1de tempest-BackendsCapabilitiesAdminTestsJSON-1533451127 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7594451904297, 'free_capacity_gb': 1773.7594451904297, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87513) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Lock "cinder-quobyte-e4ca209d-d3b4-4b51-8238-1f18123f34f4" released by "_delete_snapshot" :: held 1.693s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Lock "cinder-quobyte-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1" released by "delete_snapshot" :: held 1.724s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bb9135ba-8b77-492f-8fba-6548be88069f tempest-BackendsCapabilitiesAdminTestsJSON-1533451127 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7594451904297, 'free_capacity_gb': 1773.7594451904297, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87513) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Created reservations ['e4f9a02a-7b1f-417f-90f0-c77e01750ec7', 'd67d9d80-43c2-4bd8-9938-4f27dd2aadb1', 'd7279402-54e0-40e9-a47a-2caa52c92beb', 'cb04b460-bc90-4dd8-9463-cfa65cb4dcdd'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:56 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Delete snapshot completed successfully. Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-158af071-3019-40f9-8c14-6d92281bd918 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Lock "cinder-e4ca209d-d3b4-4b51-8238-1f18123f34f4-delete_snapshot" released by "delete_snapshot" :: held 1.912s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Flow 'volume_create_manager' (addde1fe-5881-4c20-9000-c71f929fd168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c9fc2a-266e-42d6-8652-d3f38aca4fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c9fc2a-266e-42d6-8652-d3f38aca4fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2110522668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dfda9b5-c051-47a6-a523-19bb853cefb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='281f957429b84273a1b4a2fa13195e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:56Z,use_quota=True,user_id='8a60646291e34fdd8d9f66e409955b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8754d9de-4d2c-4d33-b54d-606662d0fd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8754d9de-4d2c-4d33-b54d-606662d0fd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809a227e-17ea-4a74-9347-3901eada0e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809a227e-17ea-4a74-9347-3901eada0e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dfda9b5-c051-47a6-a523-19bb853cefb4', 'volume_name': 'volume-5dfda9b5-c051-47a6-a523-19bb853cefb4', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5dc3350-617e-4681-9352-72e1eb214e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5dc3350-617e-4681-9352-72e1eb214e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23488b76-334e-400a-815a-f919c95fa632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:56 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Volume 5dfda9b5-c051-47a6-a523-19bb853cefb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dfda9b5-c051-47a6-a523-19bb853cefb4', 'volume_size': 1} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2110522668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dfda9b5-c051-47a6-a523-19bb853cefb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='281f957429b84273a1b4a2fa13195e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:56Z,use_quota=True,user_id='8a60646291e34fdd8d9f66e409955b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Creating volume 5dfda9b5-c051-47a6-a523-19bb853cefb4 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 15:59:56 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5dfda9b5-c051-47a6-a523-19bb853cefb4 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:56 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5dfda9b5-c051-47a6-a523-19bb853cefb4 1073741824 Sep 04 15:59:56 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-469a4747-e9c0-4eb9-b139-db7b1f819e26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Acquiring lock "cinder-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-469a4747-e9c0-4eb9-b139-db7b1f819e26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Lock "cinder-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-469a4747-e9c0-4eb9-b139-db7b1f819e26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Acquiring lock "cinder-quobyte-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-469a4747-e9c0-4eb9-b139-db7b1f819e26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Lock "cinder-quobyte-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1" acquired by "delete_volume" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba48524-51e6-49e5-8e15-0d718d3cfa7c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-469a4747-e9c0-4eb9-b139-db7b1f819e26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:57 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1 Sep 04 15:59:57 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:57 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5dfda9b5-c051-47a6-a523-19bb853cefb4 1073741824" returned: 0 in 0.526s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5dfda9b5-c051-47a6-a523-19bb853cefb4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:57 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5dfda9b5-c051-47a6-a523-19bb853cefb4 Sep 04 15:59:57 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:57 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-469a4747-e9c0-4eb9-b139-db7b1f819e26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1" returned: 0 in 0.484s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-469a4747-e9c0-4eb9-b139-db7b1f819e26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:57 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1 Sep 04 15:59:57 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:57 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5dfda9b5-c051-47a6-a523-19bb853cefb4" returned: 0 in 0.295s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23488b76-334e-400a-815a-f919c95fa632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dfda9b5-c051-47a6-a523-19bb853cefb4', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808859d7-2a91-4ade-911b-4753cf14955e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:57 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Volume volume-5dfda9b5-c051-47a6-a523-19bb853cefb4 (5dfda9b5-c051-47a6-a523-19bb853cefb4): created successfully Sep 04 15:59:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808859d7-2a91-4ade-911b-4753cf14955e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Flow 'volume_create_manager' (addde1fe-5881-4c20-9000-c71f929fd168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:57 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-abbfd750-341e-471b-b4eb-251282b67e7c tempest-ProjectReaderTests-520506215 None] Created volume successfully. Sep 04 15:59:57 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-469a4747-e9c0-4eb9-b139-db7b1f819e26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1" returned: 0 in 0.284s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-469a4747-e9c0-4eb9-b139-db7b1f819e26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Lock "cinder-quobyte-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1" released by "delete_volume" :: held 0.835s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:57 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-469a4747-e9c0-4eb9-b139-db7b1f819e26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Created reservations ['98642efc-1dfd-419f-a9a1-a0a79e61331d', '1532edac-b4f4-4c80-8191-7defc742d94d', 'f5fc641a-7aa1-4da8-b895-8a9b24ea7405', 'a3040b3b-0032-4a5c-b073-def48451ba62'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-469a4747-e9c0-4eb9-b139-db7b1f819e26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-469a4747-e9c0-4eb9-b139-db7b1f819e26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-469a4747-e9c0-4eb9-b139-db7b1f819e26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-469a4747-e9c0-4eb9-b139-db7b1f819e26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-469a4747-e9c0-4eb9-b139-db7b1f819e26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-469a4747-e9c0-4eb9-b139-db7b1f819e26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:57 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:57 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:58 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-469a4747-e9c0-4eb9-b139-db7b1f819e26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.273s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:58 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-469a4747-e9c0-4eb9-b139-db7b1f819e26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:58 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-469a4747-e9c0-4eb9-b139-db7b1f819e26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Deleted volume successfully. Sep 04 15:59:58 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-469a4747-e9c0-4eb9-b139-db7b1f819e26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820562048 None] Lock "cinder-8a0824b9-e3c8-415c-b34a-b9e3978bb4f1-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:58 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0a2c98a1-5e91-45fb-a4b9-4aa8124c5176 tempest-ProjectReaderTests-520506215 None] Acquiring lock "cinder-5dfda9b5-c051-47a6-a523-19bb853cefb4-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:58 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0a2c98a1-5e91-45fb-a4b9-4aa8124c5176 tempest-ProjectReaderTests-520506215 None] Lock "cinder-5dfda9b5-c051-47a6-a523-19bb853cefb4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:58 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0a2c98a1-5e91-45fb-a4b9-4aa8124c5176 tempest-ProjectReaderTests-520506215 None] Acquiring lock "cinder-quobyte-5dfda9b5-c051-47a6-a523-19bb853cefb4" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:58 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0a2c98a1-5e91-45fb-a4b9-4aa8124c5176 tempest-ProjectReaderTests-520506215 None] Lock "cinder-quobyte-5dfda9b5-c051-47a6-a523-19bb853cefb4" acquired by "delete_volume" :: waited 0.030s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:58 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aecc9a0-5b03-43e8-ad36-a660daf23ee8]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a2c98a1-5e91-45fb-a4b9-4aa8124c5176 tempest-ProjectReaderTests-520506215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5dfda9b5-c051-47a6-a523-19bb853cefb4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:58 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5dfda9b5-c051-47a6-a523-19bb853cefb4 Sep 04 15:59:58 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:59 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a2c98a1-5e91-45fb-a4b9-4aa8124c5176 tempest-ProjectReaderTests-520506215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5dfda9b5-c051-47a6-a523-19bb853cefb4" returned: 0 in 0.426s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a2c98a1-5e91-45fb-a4b9-4aa8124c5176 tempest-ProjectReaderTests-520506215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5dfda9b5-c051-47a6-a523-19bb853cefb4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:59 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5dfda9b5-c051-47a6-a523-19bb853cefb4 Sep 04 15:59:59 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:59 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a2c98a1-5e91-45fb-a4b9-4aa8124c5176 tempest-ProjectReaderTests-520506215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5dfda9b5-c051-47a6-a523-19bb853cefb4" returned: 0 in 0.306s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0a2c98a1-5e91-45fb-a4b9-4aa8124c5176 tempest-ProjectReaderTests-520506215 None] Lock "cinder-quobyte-5dfda9b5-c051-47a6-a523-19bb853cefb4" released by "delete_volume" :: held 0.787s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:59 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-0a2c98a1-5e91-45fb-a4b9-4aa8124c5176 tempest-ProjectReaderTests-520506215 None] Created reservations ['077f735b-4a74-4c67-9d1e-36714b465dd1', 'c39be884-33ef-4940-85f5-dc9610c58169', '4a11c79a-ba57-4dfa-8283-cca9e2b5f8b8', '2e89c53a-dc85-48ac-b846-a7d978038c38'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0a2c98a1-5e91-45fb-a4b9-4aa8124c5176 tempest-ProjectReaderTests-520506215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0a2c98a1-5e91-45fb-a4b9-4aa8124c5176 tempest-ProjectReaderTests-520506215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0a2c98a1-5e91-45fb-a4b9-4aa8124c5176 tempest-ProjectReaderTests-520506215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 15:59:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0a2c98a1-5e91-45fb-a4b9-4aa8124c5176 tempest-ProjectReaderTests-520506215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 15:59:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0a2c98a1-5e91-45fb-a4b9-4aa8124c5176 tempest-ProjectReaderTests-520506215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a2c98a1-5e91-45fb-a4b9-4aa8124c5176 tempest-ProjectReaderTests-520506215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:59 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 15:59:59 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:59 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0a2c98a1-5e91-45fb-a4b9-4aa8124c5176 tempest-ProjectReaderTests-520506215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.313s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:59 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-0a2c98a1-5e91-45fb-a4b9-4aa8124c5176 tempest-ProjectReaderTests-520506215 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:59 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-0a2c98a1-5e91-45fb-a4b9-4aa8124c5176 tempest-ProjectReaderTests-520506215 None] Deleted volume successfully. Sep 04 15:59:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0a2c98a1-5e91-45fb-a4b9-4aa8124c5176 tempest-ProjectReaderTests-520506215 None] Lock "cinder-5dfda9b5-c051-47a6-a523-19bb853cefb4-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:02 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-6a32daa2-3017-48bb-be84-564f636c5c28 tempest-GroupSnapshotsTest-96941869 None] Group tempest-GroupSnapshotsTest-Group-919718669: creating Sep 04 16:00:02 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-6a32daa2-3017-48bb-be84-564f636c5c28 tempest-GroupSnapshotsTest-96941869 None] Group tempest-GroupSnapshotsTest-Group-919718669: created successfully Sep 04 16:00:02 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-6a32daa2-3017-48bb-be84-564f636c5c28 tempest-GroupSnapshotsTest-96941869 None] Create group completed successfully. Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Flow 'volume_create_manager' (40695fa4-bf17-44ff-ad13-72937f0164ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46decb43-ce46-46fd-aaea-70e4fc1afb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46decb43-ce46-46fd-aaea-70e4fc1afb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-320298330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b8d9373-820e-46d4-9b9b-978420077d67,host='devstack@QuobyteHD#QuobyteHD',id=a593b436-6ed5-4bd2-b98d-e892f116c591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e427472bc7dd4ea8b5ca7391cf31b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:04Z,use_quota=True,user_id='4d1ae2879f5d46c4b7767d2876eea20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb69078f-3ec3-4996-9a66-96c560989bc7),volume_type_id=eb69078f-3ec3-4996-9a66-96c560989bc7)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94ab654-9623-451c-a743-93e429d7b4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94ab654-9623-451c-a743-93e429d7b4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c38627c-7c7f-4eba-8f40-12cf5bedd4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c38627c-7c7f-4eba-8f40-12cf5bedd4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a593b436-6ed5-4bd2-b98d-e892f116c591', 'volume_name': 'volume-a593b436-6ed5-4bd2-b98d-e892f116c591', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f0f74a-9ff1-4b18-8c99-1e01260a4ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f0f74a-9ff1-4b18-8c99-1e01260a4ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f91ac4f-457f-4eb0-a5d1-afa38b421f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:04 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Volume a593b436-6ed5-4bd2-b98d-e892f116c591: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a593b436-6ed5-4bd2-b98d-e892f116c591', 'volume_size': 1} Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7b8d9373-820e-46d4-9b9b-978420077d67,created_at=2026-09-04T14:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-320298330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b8d9373-820e-46d4-9b9b-978420077d67,host='devstack@QuobyteHD#QuobyteHD',id=a593b436-6ed5-4bd2-b98d-e892f116c591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e427472bc7dd4ea8b5ca7391cf31b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:04Z,use_quota=True,user_id='4d1ae2879f5d46c4b7767d2876eea20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb69078f-3ec3-4996-9a66-96c560989bc7),volume_type_id=eb69078f-3ec3-4996-9a66-96c560989bc7)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Creating volume a593b436-6ed5-4bd2-b98d-e892f116c591 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:00:04 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:04 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591 1073741824 Sep 04 16:00:04 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:04 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591 1073741824" returned: 0 in 0.470s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:04 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591 Sep 04 16:00:04 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:05 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591" returned: 0 in 0.270s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:00:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f91ac4f-457f-4eb0-a5d1-afa38b421f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a593b436-6ed5-4bd2-b98d-e892f116c591', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300dd61e-926b-43c9-9fbe-ce819b55ca7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:05 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Volume volume-a593b436-6ed5-4bd2-b98d-e892f116c591 (a593b436-6ed5-4bd2-b98d-e892f116c591): created successfully Sep 04 16:00:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300dd61e-926b-43c9-9fbe-ce819b55ca7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Flow 'volume_create_manager' (40695fa4-bf17-44ff-ad13-72937f0164ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:05 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-7d83a015-ee8e-4dd8-b947-dc045859e78b tempest-GroupSnapshotsTest-96941869 None] Created volume successfully. Sep 04 16:00:05 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-0e3b0657-ed32-45c2-b93f-c8d180d18d3b tempest-GroupSnapshotsTest-96941869 None] GroupSnapshot a37f43d9-0564-42f7-8a50-623222c02a15: creating. Sep 04 16:00:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0e3b0657-ed32-45c2-b93f-c8d180d18d3b tempest-GroupSnapshotsTest-96941869 None] Group snapshot a37f43d9-0564-42f7-8a50-623222c02a15: creating. {{(pid=87513) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 16:00:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0e3b0657-ed32-45c2-b93f-c8d180d18d3b tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0e3b0657-ed32-45c2-b93f-c8d180d18d3b tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-0e3b0657-ed32-45c2-b93f-c8d180d18d3b tempest-GroupSnapshotsTest-96941869 None] Creating offline snapshot 56e93bc1-d7fc-4193-82a2-96c98b7a42e1 of volume a593b436-6ed5-4bd2-b98d-e892f116c591 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:00:05 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[02068283-7c69-429d-8d22-aca9f044c62f]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0e3b0657-ed32-45c2-b93f-c8d180d18d3b tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:05 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591 Sep 04 16:00:05 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:06 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0e3b0657-ed32-45c2-b93f-c8d180d18d3b tempest-GroupSnapshotsTest-96941869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591" returned: 0 in 0.419s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0e3b0657-ed32-45c2-b93f-c8d180d18d3b tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:06 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1 1G Sep 04 16:00:06 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:06 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0e3b0657-ed32-45c2-b93f-c8d180d18d3b tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1 1G" returned: 0 in 0.466s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0e3b0657-ed32-45c2-b93f-c8d180d18d3b tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a593b436-6ed5-4bd2-b98d-e892f116c591 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:06 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a593b436-6ed5-4bd2-b98d-e892f116c591 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1 Sep 04 16:00:06 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:07 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0e3b0657-ed32-45c2-b93f-c8d180d18d3b tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a593b436-6ed5-4bd2-b98d-e892f116c591 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1" returned: 0 in 0.302s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:07 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-0e3b0657-ed32-45c2-b93f-c8d180d18d3b tempest-GroupSnapshotsTest-96941869 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 16:00:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0e3b0657-ed32-45c2-b93f-c8d180d18d3b tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:07 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1 Sep 04 16:00:07 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:07 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0e3b0657-ed32-45c2-b93f-c8d180d18d3b tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1" returned: 0 in 0.246s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0e3b0657-ed32-45c2-b93f-c8d180d18d3b tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:07 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.info Sep 04 16:00:07 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:07 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0e3b0657-ed32-45c2-b93f-c8d180d18d3b tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.info" returned: 0 in 0.247s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:07 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-0e3b0657-ed32-45c2-b93f-c8d180d18d3b tempest-GroupSnapshotsTest-96941869 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 16:00:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0e3b0657-ed32-45c2-b93f-c8d180d18d3b tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:07 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.info Sep 04 16:00:07 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:07 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0e3b0657-ed32-45c2-b93f-c8d180d18d3b tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.info" returned: 0 in 0.233s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0e3b0657-ed32-45c2-b93f-c8d180d18d3b tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.998s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:07 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-0e3b0657-ed32-45c2-b93f-c8d180d18d3b tempest-GroupSnapshotsTest-96941869 None] group_snapshot a37f43d9-0564-42f7-8a50-623222c02a15: created successfully Sep 04 16:00:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "cinder-quobyte-56e93bc1-d7fc-4193-82a2-96c98b7a42e1-dceb3137-df4b-47ae-8e79-6cfc6b5a666f" by "_create_volume_from_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-56e93bc1-d7fc-4193-82a2-96c98b7a42e1-dceb3137-df4b-47ae-8e79-6cfc6b5a666f" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Creating volume dceb3137-df4b-47ae-8e79-6cfc6b5a666f from snapshot 56e93bc1-d7fc-4193-82a2-96c98b7a42e1 {{(pid=87513) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 04 16:00:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:00:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:00:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:00:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "cinder-quobyte-dceb3137-df4b-47ae-8e79-6cfc6b5a666f" by "_copy_volume_from_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-dceb3137-df4b-47ae-8e79-6cfc6b5a666f" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] snapshot: 56e93bc1-d7fc-4193-82a2-96c98b7a42e1, volume: dceb3137-df4b-47ae-8e79-6cfc6b5a666f, {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 04 16:00:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:00:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:00:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:08 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b80b7f-6e5a-41ca-8a31-df62db143b38]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:08 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1 Sep 04 16:00:08 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:09 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1" returned: 0 in 0.412s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:09 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a593b436-6ed5-4bd2-b98d-e892f116c591(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:00:09 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] will copy from snapshot at /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591 {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 04 16:00:09 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Creating direct copy from snapshot {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 04 16:00:09 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8852d4d4-e883-4818-8448-9ea206fe359c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:09 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591 Sep 04 16:00:09 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:09 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591" returned: 0 in 0.370s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:09 devstack cinder-volume[87513]: DEBUG cinder.utils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Path /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-dceb3137-df4b-47ae-8e79-6cfc6b5a666f not found in is_blk_device check {{(pid=87513) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 04 16:00:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-dceb3137-df4b-47ae-8e79-6cfc6b5a666f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:09 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-dceb3137-df4b-47ae-8e79-6cfc6b5a666f Sep 04 16:00:09 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:13 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:00:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Flow 'volume_create_manager' (10f4b08b-9ae3-4388-b0bd-6e05e4029866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6270303c-b39e-4897-9a5c-75e2231735ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6270303c-b39e-4897-9a5c-75e2231735ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-724618102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe46d99-bc07-41d4-8725-5a0725dcbf81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c693ebbc74944bce829e5ebf5849e8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:13Z,use_quota=True,user_id='691cbd6422624cbe83317264e4d5e633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51cecef-449c-4299-81fc-0ff6c3e0ced3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51cecef-449c-4299-81fc-0ff6c3e0ced3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923dd7e0-d0de-46fd-bb06-6c5e22dc5a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923dd7e0-d0de-46fd-bb06-6c5e22dc5a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fe46d99-bc07-41d4-8725-5a0725dcbf81', 'volume_name': 'volume-5fe46d99-bc07-41d4-8725-5a0725dcbf81', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8597ac4e-f22f-4b0f-911b-64ce325fab04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8597ac4e-f22f-4b0f-911b-64ce325fab04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40a60e3-4c6c-445b-b4c5-04a1b05916e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:13 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Volume 5fe46d99-bc07-41d4-8725-5a0725dcbf81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fe46d99-bc07-41d4-8725-5a0725dcbf81', 'volume_size': 1} Sep 04 16:00:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:13 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-dceb3137-df4b-47ae-8e79-6cfc6b5a666f" returned: 0 in 4.441s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:13 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[561bb876-0be5-453d-b5fc-04904e0379c6]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:14 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591 Sep 04 16:00:14 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:14 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591" returned: 0 in 0.525s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:14 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Image conversion details: src /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591, size 1024.00 MB, duration 4.44 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-dceb3137-df4b-47ae-8e79-6cfc6b5a666f {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:00:14 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Converted 1024.00 MB image at 230.52 MB/s Sep 04 16:00:14 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-dceb3137-df4b-47ae-8e79-6cfc6b5a666f is being set with open permissions: ugo+rw: NotImplementedError Sep 04 16:00:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-dceb3137-df4b-47ae-8e79-6cfc6b5a666f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:14 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-dceb3137-df4b-47ae-8e79-6cfc6b5a666f Sep 04 16:00:14 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:14 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-dceb3137-df4b-47ae-8e79-6cfc6b5a666f" returned: 0 in 0.238s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-dceb3137-df4b-47ae-8e79-6cfc6b5a666f" released by "_copy_volume_from_snapshot" :: held 6.090s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-56e93bc1-d7fc-4193-82a2-96c98b7a42e1-dceb3137-df4b-47ae-8e79-6cfc6b5a666f" released by "_create_volume_from_snapshot" :: held 6.131s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.149s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.151s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-724618102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe46d99-bc07-41d4-8725-5a0725dcbf81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c693ebbc74944bce829e5ebf5849e8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:13Z,use_quota=True,user_id='691cbd6422624cbe83317264e4d5e633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:00:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Creating volume 5fe46d99-bc07-41d4-8725-5a0725dcbf81 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:00:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:00:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:00:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:00:14 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:00:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5fe46d99-bc07-41d4-8725-5a0725dcbf81 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:14 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5fe46d99-bc07-41d4-8725-5a0725dcbf81 1073741824 Sep 04 16:00:14 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:14 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-41b48536-6bea-428d-9525-ca92897d2c20 tempest-GroupSnapshotsTest-96941869 None] Create group from source-snapshot-a37f43d9-0564-42f7-8a50-623222c02a15 completed successfully. Sep 04 16:00:15 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5fe46d99-bc07-41d4-8725-5a0725dcbf81 1073741824" returned: 0 in 0.410s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5fe46d99-bc07-41d4-8725-5a0725dcbf81 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:15 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5fe46d99-bc07-41d4-8725-5a0725dcbf81 Sep 04 16:00:15 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:15 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5fe46d99-bc07-41d4-8725-5a0725dcbf81" returned: 0 in 0.255s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:00:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40a60e3-4c6c-445b-b4c5-04a1b05916e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fe46d99-bc07-41d4-8725-5a0725dcbf81', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea160c6-f541-4026-808b-785920e16ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:15 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Volume volume-5fe46d99-bc07-41d4-8725-5a0725dcbf81 (5fe46d99-bc07-41d4-8725-5a0725dcbf81): created successfully Sep 04 16:00:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea160c6-f541-4026-808b-785920e16ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Flow 'volume_create_manager' (10f4b08b-9ae3-4388-b0bd-6e05e4029866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:15 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-66808d1f-e38c-4977-8d3e-652f81223bcc tempest-AbsoluteLimitsTests-1669693912 None] Created volume successfully. Sep 04 16:00:15 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1e5d5cc8-ec64-4223-a169-e10de6d79b14 tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "cinder-quobyte-dceb3137-df4b-47ae-8e79-6cfc6b5a666f" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:15 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1e5d5cc8-ec64-4223-a169-e10de6d79b14 tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-dceb3137-df4b-47ae-8e79-6cfc6b5a666f" acquired by "delete_volume" :: waited 0.021s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:15 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c07f99-3ca1-4345-8c6a-6a37c84112e9]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1e5d5cc8-ec64-4223-a169-e10de6d79b14 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-dceb3137-df4b-47ae-8e79-6cfc6b5a666f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:16 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-dceb3137-df4b-47ae-8e79-6cfc6b5a666f Sep 04 16:00:16 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:16 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1e5d5cc8-ec64-4223-a169-e10de6d79b14 tempest-GroupSnapshotsTest-96941869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-dceb3137-df4b-47ae-8e79-6cfc6b5a666f" returned: 0 in 0.356s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1e5d5cc8-ec64-4223-a169-e10de6d79b14 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-dceb3137-df4b-47ae-8e79-6cfc6b5a666f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:16 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-dceb3137-df4b-47ae-8e79-6cfc6b5a666f Sep 04 16:00:16 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:16 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1e5d5cc8-ec64-4223-a169-e10de6d79b14 tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-dceb3137-df4b-47ae-8e79-6cfc6b5a666f" returned: 0 in 0.265s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1e5d5cc8-ec64-4223-a169-e10de6d79b14 tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-dceb3137-df4b-47ae-8e79-6cfc6b5a666f" released by "delete_volume" :: held 0.662s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:16 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-1e5d5cc8-ec64-4223-a169-e10de6d79b14 tempest-GroupSnapshotsTest-96941869 None] Created reservations ['8b1afe97-20bc-45de-944a-552e4b4c74be'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:00:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e9337f9c-3f48-4908-aed1-a919c7d00374 tempest-AbsoluteLimitsTests-1669693912 None] Acquiring lock "cinder-5fe46d99-bc07-41d4-8725-5a0725dcbf81-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e9337f9c-3f48-4908-aed1-a919c7d00374 tempest-AbsoluteLimitsTests-1669693912 None] Lock "cinder-5fe46d99-bc07-41d4-8725-5a0725dcbf81-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:16 devstack cinder-volume[87513]: WARNING cinder.quota [None req-1e5d5cc8-ec64-4223-a169-e10de6d79b14 tempest-GroupSnapshotsTest-96941869 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-172793364 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-172793364, it is now deprecated. Please use the default quota class for default quota. Sep 04 16:00:16 devstack cinder-volume[87513]: WARNING cinder.quota [None req-1e5d5cc8-ec64-4223-a169-e10de6d79b14 tempest-GroupSnapshotsTest-96941869 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-172793364 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-172793364, it is now deprecated. Please use the default quota class for default quota. Sep 04 16:00:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e9337f9c-3f48-4908-aed1-a919c7d00374 tempest-AbsoluteLimitsTests-1669693912 None] Acquiring lock "cinder-quobyte-5fe46d99-bc07-41d4-8725-5a0725dcbf81" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e9337f9c-3f48-4908-aed1-a919c7d00374 tempest-AbsoluteLimitsTests-1669693912 None] Lock "cinder-quobyte-5fe46d99-bc07-41d4-8725-5a0725dcbf81" acquired by "delete_volume" :: waited 0.023s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:16 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-1e5d5cc8-ec64-4223-a169-e10de6d79b14 tempest-GroupSnapshotsTest-96941869 None] Created reservations ['b6f54b30-8df2-4a85-8c35-75a601d189d2', '2d1644b2-ebed-4025-9c21-85042d835854', '16cbdd43-b1e9-48f5-9144-507344fb0a36', '87e94b89-6e3f-484b-8bf1-e513d855535d'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:00:16 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e0ee7d-e988-4a24-bad3-e556c1bd2946]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e9337f9c-3f48-4908-aed1-a919c7d00374 tempest-AbsoluteLimitsTests-1669693912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5fe46d99-bc07-41d4-8725-5a0725dcbf81 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1e5d5cc8-ec64-4223-a169-e10de6d79b14 tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1e5d5cc8-ec64-4223-a169-e10de6d79b14 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1e5d5cc8-ec64-4223-a169-e10de6d79b14 tempest-GroupSnapshotsTest-96941869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:00:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1e5d5cc8-ec64-4223-a169-e10de6d79b14 tempest-GroupSnapshotsTest-96941869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:00:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1e5d5cc8-ec64-4223-a169-e10de6d79b14 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1e5d5cc8-ec64-4223-a169-e10de6d79b14 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:16 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5fe46d99-bc07-41d4-8725-5a0725dcbf81 Sep 04 16:00:16 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:16 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:00:16 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:17 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1e5d5cc8-ec64-4223-a169-e10de6d79b14 tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.260s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-1e5d5cc8-ec64-4223-a169-e10de6d79b14 tempest-GroupSnapshotsTest-96941869 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:00:17 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-1e5d5cc8-ec64-4223-a169-e10de6d79b14 tempest-GroupSnapshotsTest-96941869 None] Delete group completed successfully. Sep 04 16:00:17 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e9337f9c-3f48-4908-aed1-a919c7d00374 tempest-AbsoluteLimitsTests-1669693912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5fe46d99-bc07-41d4-8725-5a0725dcbf81" returned: 0 in 0.401s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e9337f9c-3f48-4908-aed1-a919c7d00374 tempest-AbsoluteLimitsTests-1669693912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5fe46d99-bc07-41d4-8725-5a0725dcbf81 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:17 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5fe46d99-bc07-41d4-8725-5a0725dcbf81 Sep 04 16:00:17 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:17 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] group_snapshot a37f43d9-0564-42f7-8a50-623222c02a15: deleting Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] group_snapshot a37f43d9-0564-42f7-8a50-623222c02a15: deleting {{(pid=87513) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "cinder-quobyte-a593b436-6ed5-4bd2-b98d-e892f116c591" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-a593b436-6ed5-4bd2-b98d-e892f116c591" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "cinder-quobyte-56e93bc1-d7fc-4193-82a2-96c98b7a42e1" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-56e93bc1-d7fc-4193-82a2-96c98b7a42e1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] Deleting offline snapshot 56e93bc1-d7fc-4193-82a2-96c98b7a42e1 of volume a593b436-6ed5-4bd2-b98d-e892f116c591 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] snapshot_file for this snap is: volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[74085407-d85f-43a6-ba46-943a8859212b]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:17 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e9337f9c-3f48-4908-aed1-a919c7d00374 tempest-AbsoluteLimitsTests-1669693912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5fe46d99-bc07-41d4-8725-5a0725dcbf81" returned: 0 in 0.277s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e9337f9c-3f48-4908-aed1-a919c7d00374 tempest-AbsoluteLimitsTests-1669693912 None] Lock "cinder-quobyte-5fe46d99-bc07-41d4-8725-5a0725dcbf81" released by "delete_volume" :: held 0.718s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:17 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1 Sep 04 16:00:17 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-e9337f9c-3f48-4908-aed1-a919c7d00374 tempest-AbsoluteLimitsTests-1669693912 None] Created reservations ['403917fa-3129-4f46-ae43-cd5de649f809', 'f2ac033c-fc95-4d15-8381-19f214b13308', 'be92213e-b808-45b4-ac9f-ef821076eead', 'fb599359-de66-4ef5-aa35-f27e6e555352'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e9337f9c-3f48-4908-aed1-a919c7d00374 tempest-AbsoluteLimitsTests-1669693912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e9337f9c-3f48-4908-aed1-a919c7d00374 tempest-AbsoluteLimitsTests-1669693912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e9337f9c-3f48-4908-aed1-a919c7d00374 tempest-AbsoluteLimitsTests-1669693912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e9337f9c-3f48-4908-aed1-a919c7d00374 tempest-AbsoluteLimitsTests-1669693912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e9337f9c-3f48-4908-aed1-a919c7d00374 tempest-AbsoluteLimitsTests-1669693912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e9337f9c-3f48-4908-aed1-a919c7d00374 tempest-AbsoluteLimitsTests-1669693912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:17 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:00:17 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:17 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1" returned: 0 in 0.378s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a593b436-6ed5-4bd2-b98d-e892f116c591(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8752d79e-0822-4325-9510-d444d2c4bc8d]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:17 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e9337f9c-3f48-4908-aed1-a919c7d00374 tempest-AbsoluteLimitsTests-1669693912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.267s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-e9337f9c-3f48-4908-aed1-a919c7d00374 tempest-AbsoluteLimitsTests-1669693912 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:00:17 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e9337f9c-3f48-4908-aed1-a919c7d00374 tempest-AbsoluteLimitsTests-1669693912 None] Deleted volume successfully. Sep 04 16:00:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e9337f9c-3f48-4908-aed1-a919c7d00374 tempest-AbsoluteLimitsTests-1669693912 None] Lock "cinder-5fe46d99-bc07-41d4-8725-5a0725dcbf81-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:17 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591 Sep 04 16:00:17 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:18 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591" returned: 0 in 0.373s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:18 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1 Sep 04 16:00:18 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:18 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1" returned: 0 in 0.337s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:18 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1 Sep 04 16:00:18 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:18 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591.56e93bc1-d7fc-4193-82a2-96c98b7a42e1" returned: 0 in 0.254s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:18 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-56e93bc1-d7fc-4193-82a2-96c98b7a42e1" released by "_delete_snapshot" :: held 1.472s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:18 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-a593b436-6ed5-4bd2-b98d-e892f116c591" released by "delete_snapshot" :: held 1.494s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:18 devstack cinder-volume[87513]: WARNING cinder.quota [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-172793364 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-172793364, it is now deprecated. Please use the default quota class for default quota. Sep 04 16:00:18 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] Created reservations ['0e518b28-348e-4007-8f83-a9b11487c1e3', '2a6c299f-7dd0-40f0-8556-77fef1492749', '07de51dc-407f-4b84-b558-744c597d6bed', 'b59f449f-3a6a-4b82-a037-804c3eba352e'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:00:18 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-112221e8-7e9b-4b52-8396-a19018b56692 tempest-GroupSnapshotsTest-96941869 None] group_snapshot a37f43d9-0564-42f7-8a50-623222c02a15: deleted successfully Sep 04 16:00:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-cf233900-36e4-4921-82a1-67e76694cdc4 tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "cinder-quobyte-a593b436-6ed5-4bd2-b98d-e892f116c591" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-cf233900-36e4-4921-82a1-67e76694cdc4 tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-a593b436-6ed5-4bd2-b98d-e892f116c591" acquired by "delete_volume" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:19 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f087c63d-cd44-4d63-b93f-5fa08eebfdc1]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-cf233900-36e4-4921-82a1-67e76694cdc4 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:19 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591 Sep 04 16:00:19 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:20 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-cf233900-36e4-4921-82a1-67e76694cdc4 tempest-GroupSnapshotsTest-96941869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591" returned: 0 in 0.378s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-cf233900-36e4-4921-82a1-67e76694cdc4 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:20 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591 Sep 04 16:00:20 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:20 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-cf233900-36e4-4921-82a1-67e76694cdc4 tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a593b436-6ed5-4bd2-b98d-e892f116c591" returned: 0 in 0.269s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:20 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-cf233900-36e4-4921-82a1-67e76694cdc4 tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-a593b436-6ed5-4bd2-b98d-e892f116c591" released by "delete_volume" :: held 0.728s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:20 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-cf233900-36e4-4921-82a1-67e76694cdc4 tempest-GroupSnapshotsTest-96941869 None] Created reservations ['27bd653e-4f46-4ed3-a1d9-93695aad8e0c'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:00:20 devstack cinder-volume[87513]: WARNING cinder.db.api [None req-cf233900-36e4-4921-82a1-67e76694cdc4 tempest-GroupSnapshotsTest-96941869 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-172793364'] Sep 04 16:00:20 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-cf233900-36e4-4921-82a1-67e76694cdc4 tempest-GroupSnapshotsTest-96941869 None] Created reservations ['dc3ac9e9-9c94-4f5d-95b1-900dc18fccf8', 'e927d799-5cc0-489a-95f4-9e91aefca1b6', '7e8b32bd-d883-46e1-a0f5-3838da23d772', '49879dbf-6238-4ffd-b7d5-65d0392a6ed0'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:00:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-cf233900-36e4-4921-82a1-67e76694cdc4 tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-cf233900-36e4-4921-82a1-67e76694cdc4 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:20 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-cf233900-36e4-4921-82a1-67e76694cdc4 tempest-GroupSnapshotsTest-96941869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:00:20 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-cf233900-36e4-4921-82a1-67e76694cdc4 tempest-GroupSnapshotsTest-96941869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:00:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-cf233900-36e4-4921-82a1-67e76694cdc4 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-cf233900-36e4-4921-82a1-67e76694cdc4 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:20 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:00:20 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:21 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-cf233900-36e4-4921-82a1-67e76694cdc4 tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.269s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:21 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-cf233900-36e4-4921-82a1-67e76694cdc4 tempest-GroupSnapshotsTest-96941869 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:00:21 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-cf233900-36e4-4921-82a1-67e76694cdc4 tempest-GroupSnapshotsTest-96941869 None] Delete group completed successfully. Sep 04 16:00:21 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:INSERT=59,cinder:SELECT=151,cinder:UPDATE=207,cinder:DELETE=18 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:00:21 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-69bebbba-7aa7-4075-b45b-adafbaedd569 tempest-GroupSnapshotsTest-96941869 None] Group tempest-GroupSnapshotsTest-Group-965220205: creating Sep 04 16:00:21 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=217,cinder:SELECT=170,cinder:DELETE=12,cinder:INSERT=45 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:00:21 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-69bebbba-7aa7-4075-b45b-adafbaedd569 tempest-GroupSnapshotsTest-96941869 None] Group tempest-GroupSnapshotsTest-Group-965220205: created successfully Sep 04 16:00:21 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-69bebbba-7aa7-4075-b45b-adafbaedd569 tempest-GroupSnapshotsTest-96941869 None] Create group completed successfully. Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Flow 'volume_create_manager' (72365f54-be5d-4864-8d01-2f4883a343b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0705ee58-271d-4c48-9c95-ac16812cec12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0705ee58-271d-4c48-9c95-ac16812cec12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2116672519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ea93905-f97a-4b1d-a988-af2b7dbe88af,host='devstack@QuobyteHD#QuobyteHD',id=547f17ec-45fc-47bb-bc9a-d4ede1f1e081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e427472bc7dd4ea8b5ca7391cf31b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:23Z,use_quota=True,user_id='4d1ae2879f5d46c4b7767d2876eea20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9a6e79b-8403-461f-8937-ed4e66a550bd),volume_type_id=b9a6e79b-8403-461f-8937-ed4e66a550bd)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8714b32-985f-4727-b3ab-04cece480570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8714b32-985f-4727-b3ab-04cece480570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3988a3a0-5d00-46b3-99ad-03833f9aa7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3988a3a0-5d00-46b3-99ad-03833f9aa7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '547f17ec-45fc-47bb-bc9a-d4ede1f1e081', 'volume_name': 'volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394236bc-7fb8-4f4f-babc-e235dad3a329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394236bc-7fb8-4f4f-babc-e235dad3a329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a39f7b-5484-420f-b396-3470e25b9d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:23 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Volume 547f17ec-45fc-47bb-bc9a-d4ede1f1e081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081', 'volume_size': 1} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2ea93905-f97a-4b1d-a988-af2b7dbe88af,created_at=2026-09-04T14:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2116672519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ea93905-f97a-4b1d-a988-af2b7dbe88af,host='devstack@QuobyteHD#QuobyteHD',id=547f17ec-45fc-47bb-bc9a-d4ede1f1e081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e427472bc7dd4ea8b5ca7391cf31b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:23Z,use_quota=True,user_id='4d1ae2879f5d46c4b7767d2876eea20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9a6e79b-8403-461f-8937-ed4e66a550bd),volume_type_id=b9a6e79b-8403-461f-8937-ed4e66a550bd)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Creating volume 547f17ec-45fc-47bb-bc9a-d4ede1f1e081 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:00:23 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:23 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081 1073741824 Sep 04 16:00:23 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Flow 'volume_create_manager' (3ad78846-81c3-4bff-a42b-078581af1114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4f09d4-9c39-46d7-af81-64c934b6f1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4f09d4-9c39-46d7-af81-64c934b6f1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1345627927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3ad31e496348f283660e34cf9d127a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:23Z,use_quota=True,user_id='15715eca8b70401499ca825f63dbccc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8daee0e8-7d05-4b79-a93b-8679fe484dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8daee0e8-7d05-4b79-a93b-8679fe484dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c89c98-0e7e-4a67-91bf-b7830436a859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c89c98-0e7e-4a67-91bf-b7830436a859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a', 'volume_name': 'volume-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f3707b-5dea-4699-a20a-67eec017334d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f3707b-5dea-4699-a20a-67eec017334d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba4216f-7ad9-412b-aab8-b3cd2cdd6e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:23 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Volume 8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a', 'volume_size': 1} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:23 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081 1073741824" returned: 0 in 0.426s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:23 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081 Sep 04 16:00:23 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:23 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081" returned: 0 in 0.230s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.339s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1345627927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3ad31e496348f283660e34cf9d127a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:23Z,use_quota=True,user_id='15715eca8b70401499ca825f63dbccc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Creating volume 8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:00:23 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a39f7b-5484-420f-b396-3470e25b9d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:23 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a 1073741824 Sep 04 16:00:23 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573c0db0-e7f5-4207-810b-8eddc56a07f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:23 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Volume volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081 (547f17ec-45fc-47bb-bc9a-d4ede1f1e081): created successfully Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573c0db0-e7f5-4207-810b-8eddc56a07f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Flow 'volume_create_manager' (72365f54-be5d-4864-8d01-2f4883a343b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:23 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-d7ceb07a-4958-4889-9e23-4766bef5d25e tempest-GroupSnapshotsTest-96941869 None] Created volume successfully. Sep 04 16:00:24 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a 1073741824" returned: 0 in 0.449s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:24 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a Sep 04 16:00:24 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:24 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a" returned: 0 in 0.248s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba4216f-7ad9-412b-aab8-b3cd2cdd6e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c50002-7608-4582-b317-84ec0cf45a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:24 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Volume volume-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a (8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a): created successfully Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c50002-7608-4582-b317-84ec0cf45a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Flow 'volume_create_manager' (3ad78846-81c3-4bff-a42b-078581af1114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:24 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-39719369-e476-4400-88a4-81be396ffe76 tempest-VolumesTransfersTest-647002197 None] Created volume successfully. Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Flow 'volume_create_manager' (c835b772-5e8d-470d-8fda-fccbe3ecdff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3385de52-66ec-4b2b-a34a-2d919b1b2aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3385de52-66ec-4b2b-a34a-2d919b1b2aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1409372103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ea93905-f97a-4b1d-a988-af2b7dbe88af,host='devstack@QuobyteHD#QuobyteHD',id=c662b372-edc4-4b05-830b-b125c1bd5370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e427472bc7dd4ea8b5ca7391cf31b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:25Z,use_quota=True,user_id='4d1ae2879f5d46c4b7767d2876eea20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9a6e79b-8403-461f-8937-ed4e66a550bd),volume_type_id=b9a6e79b-8403-461f-8937-ed4e66a550bd)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d101fda-5fe8-46bd-b743-3d34a14351e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d101fda-5fe8-46bd-b743-3d34a14351e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1fc84ba-1c44-4def-a158-e3271780027c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1fc84ba-1c44-4def-a158-e3271780027c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c662b372-edc4-4b05-830b-b125c1bd5370', 'volume_name': 'volume-c662b372-edc4-4b05-830b-b125c1bd5370', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe96dbd9-1515-4305-a413-853e3f66e704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe96dbd9-1515-4305-a413-853e3f66e704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f9f42d-5935-4b1f-bbd0-731aafb85ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:24 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Volume c662b372-edc4-4b05-830b-b125c1bd5370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c662b372-edc4-4b05-830b-b125c1bd5370', 'volume_size': 1} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2ea93905-f97a-4b1d-a988-af2b7dbe88af,created_at=2026-09-04T14:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1409372103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ea93905-f97a-4b1d-a988-af2b7dbe88af,host='devstack@QuobyteHD#QuobyteHD',id=c662b372-edc4-4b05-830b-b125c1bd5370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e427472bc7dd4ea8b5ca7391cf31b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:25Z,use_quota=True,user_id='4d1ae2879f5d46c4b7767d2876eea20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9a6e79b-8403-461f-8937-ed4e66a550bd),volume_type_id=b9a6e79b-8403-461f-8937-ed4e66a550bd)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Creating volume c662b372-edc4-4b05-830b-b125c1bd5370 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:00:24 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:00:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:24 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370 1073741824 Sep 04 16:00:24 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:25 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370 1073741824" returned: 0 in 0.385s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:25 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370 Sep 04 16:00:25 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:25 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370" returned: 0 in 0.238s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:00:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f9f42d-5935-4b1f-bbd0-731aafb85ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c662b372-edc4-4b05-830b-b125c1bd5370', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9bff51-7a2c-4649-9b18-42e452406c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:25 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Volume volume-c662b372-edc4-4b05-830b-b125c1bd5370 (c662b372-edc4-4b05-830b-b125c1bd5370): created successfully Sep 04 16:00:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9bff51-7a2c-4649-9b18-42e452406c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Flow 'volume_create_manager' (c835b772-5e8d-470d-8fda-fccbe3ecdff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:25 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-52ee8bbe-3af0-4cc4-95f8-09f11dfba6b4 tempest-GroupSnapshotsTest-96941869 None] Created volume successfully. Sep 04 16:00:26 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-82db1178-3cb2-4a02-aaca-d93a6add32cd tempest-VolumesTransfersTest-1314607920 None] Transfer volume completed successfully. Sep 04 16:00:26 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-bb0be24f-b47f-45d5-a784-19f67256a63d tempest-GroupSnapshotsTest-96941869 None] Update group completed successfully. Sep 04 16:00:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d6ed2126-9cfc-4e2b-b48e-d053e7809f41 tempest-VolumesTransfersTest-1761464035 None] Acquiring lock "cinder-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d6ed2126-9cfc-4e2b-b48e-d053e7809f41 tempest-VolumesTransfersTest-1761464035 None] Lock "cinder-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d6ed2126-9cfc-4e2b-b48e-d053e7809f41 tempest-VolumesTransfersTest-1761464035 None] Acquiring lock "cinder-quobyte-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d6ed2126-9cfc-4e2b-b48e-d053e7809f41 tempest-VolumesTransfersTest-1761464035 None] Lock "cinder-quobyte-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a" acquired by "delete_volume" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:26 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1290e67a-9575-40eb-9c1d-b8cb793ecb0c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d6ed2126-9cfc-4e2b-b48e-d053e7809f41 tempest-VolumesTransfersTest-1761464035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:26 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a Sep 04 16:00:26 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:27 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d6ed2126-9cfc-4e2b-b48e-d053e7809f41 tempest-VolumesTransfersTest-1761464035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a" returned: 0 in 0.368s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d6ed2126-9cfc-4e2b-b48e-d053e7809f41 tempest-VolumesTransfersTest-1761464035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:27 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a Sep 04 16:00:27 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:27 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d6ed2126-9cfc-4e2b-b48e-d053e7809f41 tempest-VolumesTransfersTest-1761464035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a" returned: 0 in 0.268s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d6ed2126-9cfc-4e2b-b48e-d053e7809f41 tempest-VolumesTransfersTest-1761464035 None] Lock "cinder-quobyte-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a" released by "delete_volume" :: held 0.678s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:27 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-71460bac-23ce-4a1e-b036-0ea0621ae30f tempest-GroupSnapshotsTest-96941869 None] Update group completed successfully. Sep 04 16:00:27 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-d6ed2126-9cfc-4e2b-b48e-d053e7809f41 tempest-VolumesTransfersTest-1761464035 None] Created reservations ['fbacf785-2567-4c49-8ca4-39a3e3f9d5db', 'ccbea1a6-a89f-41f6-8cdf-1fca6fd03e1b', 'bfd15742-96da-4ed4-b853-8e46aa1d3ad0', 'c30e3280-240e-4436-809b-d1955ad16a74'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:00:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d6ed2126-9cfc-4e2b-b48e-d053e7809f41 tempest-VolumesTransfersTest-1761464035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d6ed2126-9cfc-4e2b-b48e-d053e7809f41 tempest-VolumesTransfersTest-1761464035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:27 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d6ed2126-9cfc-4e2b-b48e-d053e7809f41 tempest-VolumesTransfersTest-1761464035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:00:27 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d6ed2126-9cfc-4e2b-b48e-d053e7809f41 tempest-VolumesTransfersTest-1761464035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:00:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d6ed2126-9cfc-4e2b-b48e-d053e7809f41 tempest-VolumesTransfersTest-1761464035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d6ed2126-9cfc-4e2b-b48e-d053e7809f41 tempest-VolumesTransfersTest-1761464035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:27 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:00:27 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:27 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d6ed2126-9cfc-4e2b-b48e-d053e7809f41 tempest-VolumesTransfersTest-1761464035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.232s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:27 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-d6ed2126-9cfc-4e2b-b48e-d053e7809f41 tempest-VolumesTransfersTest-1761464035 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:00:27 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-d6ed2126-9cfc-4e2b-b48e-d053e7809f41 tempest-VolumesTransfersTest-1761464035 None] Deleted volume successfully. Sep 04 16:00:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d6ed2126-9cfc-4e2b-b48e-d053e7809f41 tempest-VolumesTransfersTest-1761464035 None] Lock "cinder-8c1b9119-8cbd-4d7c-9418-ce734d9e5e6a-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Flow 'volume_create_manager' (df42f0f8-bff6-4915-bf38-1480fb5751f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de43db39-9c75-4be9-b72c-553cbda27795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de43db39-9c75-4be9-b72c-553cbda27795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1938583580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106e4961-bc2f-49fa-a516-13840d9f1dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3ad31e496348f283660e34cf9d127a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:28Z,use_quota=True,user_id='15715eca8b70401499ca825f63dbccc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17372ccd-1217-48ea-9b0b-d0e276f1ddb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17372ccd-1217-48ea-9b0b-d0e276f1ddb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ad4fb9-3633-4e3a-b464-b175c9a7b8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ad4fb9-3633-4e3a-b464-b175c9a7b8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '106e4961-bc2f-49fa-a516-13840d9f1dc9', 'volume_name': 'volume-106e4961-bc2f-49fa-a516-13840d9f1dc9', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb2a854-4509-4f38-ac16-3c88b75ee6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb2a854-4509-4f38-ac16-3c88b75ee6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (210c9100-b3e8-471c-8b63-14f4b43c184a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:28 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Volume 106e4961-bc2f-49fa-a516-13840d9f1dc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-106e4961-bc2f-49fa-a516-13840d9f1dc9', 'volume_size': 1} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1938583580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106e4961-bc2f-49fa-a516-13840d9f1dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3ad31e496348f283660e34cf9d127a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:28Z,use_quota=True,user_id='15715eca8b70401499ca825f63dbccc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Creating volume 106e4961-bc2f-49fa-a516-13840d9f1dc9 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:00:28 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-106e4961-bc2f-49fa-a516-13840d9f1dc9 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:28 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-106e4961-bc2f-49fa-a516-13840d9f1dc9 1073741824 Sep 04 16:00:28 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:28 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-1624a20b-4ad8-4828-9333-7e06355e2e4a tempest-GroupSnapshotsTest-96941869 None] Update group completed successfully. Sep 04 16:00:28 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-106e4961-bc2f-49fa-a516-13840d9f1dc9 1073741824" returned: 0 in 0.417s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-106e4961-bc2f-49fa-a516-13840d9f1dc9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:28 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-106e4961-bc2f-49fa-a516-13840d9f1dc9 Sep 04 16:00:28 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:28 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-106e4961-bc2f-49fa-a516-13840d9f1dc9" returned: 0 in 0.232s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:00:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (210c9100-b3e8-471c-8b63-14f4b43c184a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-106e4961-bc2f-49fa-a516-13840d9f1dc9', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a9fcc9a-86c3-4251-ab12-c6c2bd63ef1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:29 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Volume volume-106e4961-bc2f-49fa-a516-13840d9f1dc9 (106e4961-bc2f-49fa-a516-13840d9f1dc9): created successfully Sep 04 16:00:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a9fcc9a-86c3-4251-ab12-c6c2bd63ef1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Flow 'volume_create_manager' (df42f0f8-bff6-4915-bf38-1480fb5751f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:29 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ef340f97-b2ca-48a1-8c63-81b59987a05d tempest-VolumesTransfersTest-647002197 None] Created volume successfully. Sep 04 16:00:29 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-26095536-8ed9-478b-8110-6eec2f7bf845 tempest-VolumesTransfersTest-1761464035 None] Acquiring lock "cinder-106e4961-bc2f-49fa-a516-13840d9f1dc9-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:29 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-26095536-8ed9-478b-8110-6eec2f7bf845 tempest-VolumesTransfersTest-1761464035 None] Lock "cinder-106e4961-bc2f-49fa-a516-13840d9f1dc9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:29 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-26095536-8ed9-478b-8110-6eec2f7bf845 tempest-VolumesTransfersTest-1761464035 None] Acquiring lock "cinder-quobyte-106e4961-bc2f-49fa-a516-13840d9f1dc9" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:29 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-26095536-8ed9-478b-8110-6eec2f7bf845 tempest-VolumesTransfersTest-1761464035 None] Lock "cinder-quobyte-106e4961-bc2f-49fa-a516-13840d9f1dc9" acquired by "delete_volume" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:29 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[789e1699-8b07-4551-a9c8-99b0769c1b05]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-26095536-8ed9-478b-8110-6eec2f7bf845 tempest-VolumesTransfersTest-1761464035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-106e4961-bc2f-49fa-a516-13840d9f1dc9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:29 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-106e4961-bc2f-49fa-a516-13840d9f1dc9 Sep 04 16:00:29 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:29 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-2d4a6887-c561-4963-9a83-6eb1a325397b tempest-GroupSnapshotsTest-96941869 None] Update group completed successfully. Sep 04 16:00:29 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-26095536-8ed9-478b-8110-6eec2f7bf845 tempest-VolumesTransfersTest-1761464035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-106e4961-bc2f-49fa-a516-13840d9f1dc9" returned: 0 in 0.369s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-26095536-8ed9-478b-8110-6eec2f7bf845 tempest-VolumesTransfersTest-1761464035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-106e4961-bc2f-49fa-a516-13840d9f1dc9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:29 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-106e4961-bc2f-49fa-a516-13840d9f1dc9 Sep 04 16:00:29 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:30 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-26095536-8ed9-478b-8110-6eec2f7bf845 tempest-VolumesTransfersTest-1761464035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-106e4961-bc2f-49fa-a516-13840d9f1dc9" returned: 0 in 0.240s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-26095536-8ed9-478b-8110-6eec2f7bf845 tempest-VolumesTransfersTest-1761464035 None] Lock "cinder-quobyte-106e4961-bc2f-49fa-a516-13840d9f1dc9" released by "delete_volume" :: held 0.655s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:30 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-26095536-8ed9-478b-8110-6eec2f7bf845 tempest-VolumesTransfersTest-1761464035 None] Created reservations ['0329e3c2-3c4e-4ce0-b7d3-501a036fe58d', 'b0357062-7279-4a70-91e0-2d4ce3a2d4ad', '4c259a1d-72b5-4a98-912d-059b95496e7a', 'de033ed5-c253-4b13-a860-737380508959'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:00:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-26095536-8ed9-478b-8110-6eec2f7bf845 tempest-VolumesTransfersTest-1761464035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-26095536-8ed9-478b-8110-6eec2f7bf845 tempest-VolumesTransfersTest-1761464035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-26095536-8ed9-478b-8110-6eec2f7bf845 tempest-VolumesTransfersTest-1761464035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:00:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-26095536-8ed9-478b-8110-6eec2f7bf845 tempest-VolumesTransfersTest-1761464035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:00:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-26095536-8ed9-478b-8110-6eec2f7bf845 tempest-VolumesTransfersTest-1761464035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-26095536-8ed9-478b-8110-6eec2f7bf845 tempest-VolumesTransfersTest-1761464035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:30 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:00:30 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:30 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-26095536-8ed9-478b-8110-6eec2f7bf845 tempest-VolumesTransfersTest-1761464035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.237s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:30 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-26095536-8ed9-478b-8110-6eec2f7bf845 tempest-VolumesTransfersTest-1761464035 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:00:30 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-26095536-8ed9-478b-8110-6eec2f7bf845 tempest-VolumesTransfersTest-1761464035 None] Deleted volume successfully. Sep 04 16:00:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-26095536-8ed9-478b-8110-6eec2f7bf845 tempest-VolumesTransfersTest-1761464035 None] Lock "cinder-106e4961-bc2f-49fa-a516-13840d9f1dc9-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:31 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] GroupSnapshot 7d14d8e9-efa5-4924-9723-153118274280: creating. Sep 04 16:00:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] Group snapshot 7d14d8e9-efa5-4924-9723-153118274280: creating. {{(pid=87513) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 16:00:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] Creating offline snapshot 9574c23a-ef0e-4864-8b30-83d1c66863d7 of volume c662b372-edc4-4b05-830b-b125c1bd5370 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:00:31 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73e6fde-5780-41c0-9005-95b5886cb56c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:31 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370 Sep 04 16:00:31 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:31 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370" returned: 0 in 0.387s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.9574c23a-ef0e-4864-8b30-83d1c66863d7 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:31 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.9574c23a-ef0e-4864-8b30-83d1c66863d7 1G Sep 04 16:00:31 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:32 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.9574c23a-ef0e-4864-8b30-83d1c66863d7 1G" returned: 0 in 0.457s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c662b372-edc4-4b05-830b-b125c1bd5370 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.9574c23a-ef0e-4864-8b30-83d1c66863d7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:32 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c662b372-edc4-4b05-830b-b125c1bd5370 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.9574c23a-ef0e-4864-8b30-83d1c66863d7 Sep 04 16:00:32 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:32 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c662b372-edc4-4b05-830b-b125c1bd5370 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.9574c23a-ef0e-4864-8b30-83d1c66863d7" returned: 0 in 0.316s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:32 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.9574c23a-ef0e-4864-8b30-83d1c66863d7 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 16:00:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.9574c23a-ef0e-4864-8b30-83d1c66863d7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:32 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.9574c23a-ef0e-4864-8b30-83d1c66863d7 Sep 04 16:00:32 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:32 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.9574c23a-ef0e-4864-8b30-83d1c66863d7" returned: 0 in 0.253s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:32 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.info Sep 04 16:00:32 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:32 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.info" returned: 0 in 0.264s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:32 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 16:00:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:32 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.info Sep 04 16:00:32 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:33 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.info" returned: 0 in 0.256s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.021s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] Creating offline snapshot d089888f-5408-4680-99f7-d231fbe9691c of volume 547f17ec-45fc-47bb-bc9a-d4ede1f1e081 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:00:33 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83a6fb6-ab92-45cd-bcc0-ecdaa5bd621e]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:33 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081 Sep 04 16:00:33 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:33 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081" returned: 0 in 0.399s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.d089888f-5408-4680-99f7-d231fbe9691c 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:33 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.d089888f-5408-4680-99f7-d231fbe9691c 1G Sep 04 16:00:33 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:34 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.d089888f-5408-4680-99f7-d231fbe9691c 1G" returned: 0 in 0.461s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.d089888f-5408-4680-99f7-d231fbe9691c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:34 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.d089888f-5408-4680-99f7-d231fbe9691c Sep 04 16:00:34 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:34 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.d089888f-5408-4680-99f7-d231fbe9691c" returned: 0 in 0.328s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:34 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.d089888f-5408-4680-99f7-d231fbe9691c is being set with open permissions: ugo+rw: NotImplementedError Sep 04 16:00:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.d089888f-5408-4680-99f7-d231fbe9691c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:34 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.d089888f-5408-4680-99f7-d231fbe9691c Sep 04 16:00:34 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:34 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.d089888f-5408-4680-99f7-d231fbe9691c" returned: 0 in 0.259s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:34 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.info Sep 04 16:00:34 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:00:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:00:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:00:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:34 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:00:34 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:35 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.info" returned: 0 in 0.275s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:35 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 16:00:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:35 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.info Sep 04 16:00:35 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:35 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.259s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:00:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:00:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 28 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:00:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 16:00:35 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.info" returned: 0 in 0.263s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.086s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:35 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-64ca6e21-c966-4e9f-a84d-f76ceb3d24ec tempest-GroupSnapshotsTest-96941869 None] group_snapshot 7d14d8e9-efa5-4924-9723-153118274280: created successfully Sep 04 16:00:36 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] group_snapshot 7d14d8e9-efa5-4924-9723-153118274280: deleting Sep 04 16:00:36 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] group_snapshot 7d14d8e9-efa5-4924-9723-153118274280: deleting {{(pid=87513) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 16:00:36 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "cinder-quobyte-c662b372-edc4-4b05-830b-b125c1bd5370" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:36 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-c662b372-edc4-4b05-830b-b125c1bd5370" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:36 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "cinder-quobyte-9574c23a-ef0e-4864-8b30-83d1c66863d7" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:36 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-9574c23a-ef0e-4864-8b30-83d1c66863d7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:36 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Deleting offline snapshot 9574c23a-ef0e-4864-8b30-83d1c66863d7 of volume c662b372-edc4-4b05-830b-b125c1bd5370 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:00:36 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] snapshot_file for this snap is: volume-c662b372-edc4-4b05-830b-b125c1bd5370.9574c23a-ef0e-4864-8b30-83d1c66863d7 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:00:36 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a0d113-4571-4fe1-99f1-5ecd0fd16afd]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.9574c23a-ef0e-4864-8b30-83d1c66863d7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:36 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.9574c23a-ef0e-4864-8b30-83d1c66863d7 Sep 04 16:00:36 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:37 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.9574c23a-ef0e-4864-8b30-83d1c66863d7" returned: 0 in 0.414s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c662b372-edc4-4b05-830b-b125c1bd5370(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:00:37 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eed627b-8baf-4940-baad-f023ea4d7a7b]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:37 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370 Sep 04 16:00:37 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:37 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370" returned: 0 in 0.341s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.9574c23a-ef0e-4864-8b30-83d1c66863d7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:37 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.9574c23a-ef0e-4864-8b30-83d1c66863d7 Sep 04 16:00:37 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:37 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.9574c23a-ef0e-4864-8b30-83d1c66863d7" returned: 0 in 0.363s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.9574c23a-ef0e-4864-8b30-83d1c66863d7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:37 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.9574c23a-ef0e-4864-8b30-83d1c66863d7 Sep 04 16:00:37 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:38 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370.9574c23a-ef0e-4864-8b30-83d1c66863d7" returned: 0 in 0.244s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-9574c23a-ef0e-4864-8b30-83d1c66863d7" released by "_delete_snapshot" :: held 1.478s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-c662b372-edc4-4b05-830b-b125c1bd5370" released by "delete_snapshot" :: held 1.511s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "cinder-quobyte-547f17ec-45fc-47bb-bc9a-d4ede1f1e081" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-547f17ec-45fc-47bb-bc9a-d4ede1f1e081" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "cinder-quobyte-d089888f-5408-4680-99f7-d231fbe9691c" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-d089888f-5408-4680-99f7-d231fbe9691c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:38 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Deleting offline snapshot d089888f-5408-4680-99f7-d231fbe9691c of volume 547f17ec-45fc-47bb-bc9a-d4ede1f1e081 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:00:38 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] snapshot_file for this snap is: volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.d089888f-5408-4680-99f7-d231fbe9691c {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:00:38 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f34d3c-6dab-4331-963c-3876d9429dcb]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.d089888f-5408-4680-99f7-d231fbe9691c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:38 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.d089888f-5408-4680-99f7-d231fbe9691c Sep 04 16:00:38 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:38 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.d089888f-5408-4680-99f7-d231fbe9691c" returned: 0 in 0.371s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:38 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:00:38 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0751d0-f662-4b6d-9f67-d7b278e936a9]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:38 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081 Sep 04 16:00:38 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:39 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081" returned: 0 in 0.389s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.d089888f-5408-4680-99f7-d231fbe9691c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:39 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.d089888f-5408-4680-99f7-d231fbe9691c Sep 04 16:00:39 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:39 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.d089888f-5408-4680-99f7-d231fbe9691c" returned: 0 in 0.350s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.d089888f-5408-4680-99f7-d231fbe9691c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:39 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.d089888f-5408-4680-99f7-d231fbe9691c Sep 04 16:00:39 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:39 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081.d089888f-5408-4680-99f7-d231fbe9691c" returned: 0 in 0.242s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-d089888f-5408-4680-99f7-d231fbe9691c" released by "_delete_snapshot" :: held 1.447s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-547f17ec-45fc-47bb-bc9a-d4ede1f1e081" released by "delete_snapshot" :: held 1.472s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:39 devstack cinder-volume[87513]: WARNING cinder.quota [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1937237350 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1937237350, it is now deprecated. Please use the default quota class for default quota. Sep 04 16:00:39 devstack cinder-volume[87513]: WARNING cinder.quota [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1937237350 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1937237350, it is now deprecated. Please use the default quota class for default quota. Sep 04 16:00:39 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Created reservations ['ccadb32a-5e21-4919-80e1-25bdf29686e8', '1d0ae626-1ce6-4136-96cb-5291e7e4a7e3', '7bc39188-747a-4257-ba6e-694498d2edf3', '655ac06e-283f-4cc9-9455-b6c70905f04f'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:00:39 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] Created reservations ['eaa78348-8265-45cc-9b3f-622f3e58b5b7', 'ab39ba69-46af-41c6-a484-3ae63fa3850a', 'a29a7ec2-bc8b-4cfa-8477-f1ec417736b8', 'c785446a-2e5d-4b26-abf4-e2b5c14eb2b5'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:00:40 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-39e7821e-8a4e-4c2a-9421-e27f1ede33fc tempest-GroupSnapshotsTest-96941869 None] group_snapshot 7d14d8e9-efa5-4924-9723-153118274280: deleted successfully Sep 04 16:00:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "cinder-quobyte-547f17ec-45fc-47bb-bc9a-d4ede1f1e081" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-547f17ec-45fc-47bb-bc9a-d4ede1f1e081" acquired by "delete_volume" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:40 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdce6543-3bea-4d22-a1fb-dcf98fd309bc]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:40 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081 Sep 04 16:00:40 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:40 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081" returned: 0 in 0.396s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:40 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081 Sep 04 16:00:40 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:41 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-547f17ec-45fc-47bb-bc9a-d4ede1f1e081" returned: 0 in 0.283s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-547f17ec-45fc-47bb-bc9a-d4ede1f1e081" released by "delete_volume" :: held 0.780s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "cinder-quobyte-c662b372-edc4-4b05-830b-b125c1bd5370" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-c662b372-edc4-4b05-830b-b125c1bd5370" acquired by "delete_volume" :: waited 0.023s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:41 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[49131955-8603-4cc5-a3ea-c8302609bd7e]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:41 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370 Sep 04 16:00:41 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:41 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370" returned: 0 in 0.421s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:41 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370 Sep 04 16:00:41 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:42 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c662b372-edc4-4b05-830b-b125c1bd5370" returned: 0 in 0.331s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-c662b372-edc4-4b05-830b-b125c1bd5370" released by "delete_volume" :: held 0.822s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:42 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Created reservations ['e0e3cc0f-b3dc-4a77-8171-25e0311f3821'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:00:42 devstack cinder-volume[87513]: WARNING cinder.quota [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1937237350 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1937237350, it is now deprecated. Please use the default quota class for default quota. Sep 04 16:00:42 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Created reservations ['0b723cd0-ebdd-4e58-bfaa-40218ca5571d', 'd8f99efe-f6df-4930-8c95-9187cbaea087', '1323cf19-8cb7-4bf5-8386-b07e2dedab61', 'ccf7365f-4b06-4d05-934d-2842a1b7bc38'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:00:42 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Created reservations ['b2d407b1-5cb9-4761-a25e-a34fa859399f', '5137b9dc-7e3e-4579-804f-0e0d9c45bf65', '29e4da43-8aad-4739-a140-82ab5edfa1be', '929c66c3-b18f-4389-b581-2e60539605d4'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:00:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:00:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:00:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:42 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:00:42 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:42 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.249s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:42 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:00:42 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-112198d7-7481-424b-a5bc-90131d7582f8 tempest-GroupSnapshotsTest-96941869 None] Delete group completed successfully. Sep 04 16:00:43 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-2d1e3f80-3532-47e9-87a4-2a10752afb57 tempest-GroupSnapshotsTest-96941869 None] Group tempest-GroupSnapshotsTest-Group-696033887: creating Sep 04 16:00:43 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-2d1e3f80-3532-47e9-87a4-2a10752afb57 tempest-GroupSnapshotsTest-96941869 None] Group tempest-GroupSnapshotsTest-Group-696033887: created successfully Sep 04 16:00:43 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-2d1e3f80-3532-47e9-87a4-2a10752afb57 tempest-GroupSnapshotsTest-96941869 None] Create group completed successfully. Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Flow 'volume_create_manager' (8cc771a6-6682-4343-bb4c-cf6a2b4f38d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4fc0f9-91f1-4a33-899f-4f4cc6ff0be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4fc0f9-91f1-4a33-899f-4f4cc6ff0be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2037549331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a9663b-0578-444b-96f5-56da098fcfc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5420cbb5c24bd39957aaf8557e7001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:45Z,use_quota=True,user_id='5e87875de72147e9be9ed0b2b9da32e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d487632-b3e7-4dbe-b79d-7a45280f8e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d487632-b3e7-4dbe-b79d-7a45280f8e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba7937a-91a0-4bd2-933b-9caaf4700ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba7937a-91a0-4bd2-933b-9caaf4700ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77a9663b-0578-444b-96f5-56da098fcfc0', 'volume_name': 'volume-77a9663b-0578-444b-96f5-56da098fcfc0', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1087b5b8-6f1d-4d18-ad41-128c43651c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1087b5b8-6f1d-4d18-ad41-128c43651c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a133ac8-b2ba-4fa2-86c1-0fa83d133119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:44 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Volume 77a9663b-0578-444b-96f5-56da098fcfc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77a9663b-0578-444b-96f5-56da098fcfc0', 'volume_size': 1} Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2037549331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a9663b-0578-444b-96f5-56da098fcfc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5420cbb5c24bd39957aaf8557e7001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:45Z,use_quota=True,user_id='5e87875de72147e9be9ed0b2b9da32e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Creating volume 77a9663b-0578-444b-96f5-56da098fcfc0 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:00:44 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:00:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:44 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 1073741824 Sep 04 16:00:44 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Flow 'volume_create_manager' (c7a802a8-8671-4199-9ff6-b42c488221bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0213d688-c6aa-49d5-b719-f9c7cd39f0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0213d688-c6aa-49d5-b719-f9c7cd39f0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-443032850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=27ab17ae-4e42-46b8-88ae-dfe78b74e024,host='devstack@QuobyteHD#QuobyteHD',id=67bb85ea-4137-45c7-a705-1205a9521071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e427472bc7dd4ea8b5ca7391cf31b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:45Z,use_quota=True,user_id='4d1ae2879f5d46c4b7767d2876eea20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd52a117-2476-4360-8ec4-578baa7e7c3b),volume_type_id=dd52a117-2476-4360-8ec4-578baa7e7c3b)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74c6b97-73d5-4a5f-8fc7-dfde0facc71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74c6b97-73d5-4a5f-8fc7-dfde0facc71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6f6923-844c-43ae-921e-ff2a49996466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6f6923-844c-43ae-921e-ff2a49996466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67bb85ea-4137-45c7-a705-1205a9521071', 'volume_name': 'volume-67bb85ea-4137-45c7-a705-1205a9521071', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:45 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8fa348f-510b-4c6a-bd8a-62b902563703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8fa348f-510b-4c6a-bd8a-62b902563703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a183b842-3995-4e59-b0fc-f8b096addad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:45 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Volume 67bb85ea-4137-45c7-a705-1205a9521071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67bb85ea-4137-45c7-a705-1205a9521071', 'volume_size': 1} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 1073741824" returned: 0 in 0.490s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:45 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 Sep 04 16:00:45 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:45 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0" returned: 0 in 0.247s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.280s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=27ab17ae-4e42-46b8-88ae-dfe78b74e024,created_at=2026-09-04T14:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-443032850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=27ab17ae-4e42-46b8-88ae-dfe78b74e024,host='devstack@QuobyteHD#QuobyteHD',id=67bb85ea-4137-45c7-a705-1205a9521071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e427472bc7dd4ea8b5ca7391cf31b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:45Z,use_quota=True,user_id='4d1ae2879f5d46c4b7767d2876eea20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd52a117-2476-4360-8ec4-578baa7e7c3b),volume_type_id=dd52a117-2476-4360-8ec4-578baa7e7c3b)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Creating volume 67bb85ea-4137-45c7-a705-1205a9521071 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:00:45 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a133ac8-b2ba-4fa2-86c1-0fa83d133119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77a9663b-0578-444b-96f5-56da098fcfc0', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:45 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071 1073741824 Sep 04 16:00:45 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08c5549-f0e6-4c77-9876-a3b1308ffc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:45 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Volume volume-77a9663b-0578-444b-96f5-56da098fcfc0 (77a9663b-0578-444b-96f5-56da098fcfc0): created successfully Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08c5549-f0e6-4c77-9876-a3b1308ffc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Flow 'volume_create_manager' (8cc771a6-6682-4343-bb4c-cf6a2b4f38d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:45 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-3fab66db-bffa-420c-a132-4d0d444c60fc tempest-VolumesActionsTest-127509361 None] Created volume successfully. Sep 04 16:00:45 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071 1073741824" returned: 0 in 0.400s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:45 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071 Sep 04 16:00:45 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:46 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071" returned: 0 in 0.239s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:00:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a183b842-3995-4e59-b0fc-f8b096addad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67bb85ea-4137-45c7-a705-1205a9521071', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90aea87-e035-4d3f-a2a1-e4356472b8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:46 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Volume volume-67bb85ea-4137-45c7-a705-1205a9521071 (67bb85ea-4137-45c7-a705-1205a9521071): created successfully Sep 04 16:00:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90aea87-e035-4d3f-a2a1-e4356472b8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:46 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Flow 'volume_create_manager' (c7a802a8-8671-4199-9ff6-b42c488221bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:46 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-9fb03035-c32b-4cd1-a125-08ccd59cf527 tempest-GroupSnapshotsTest-96941869 None] Created volume successfully. Sep 04 16:00:47 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-79aff8da-4122-48f4-8019-e1b7ca7965ec tempest-GroupSnapshotsTest-96941869 None] GroupSnapshot 2973eb18-62de-4131-93bc-57bc7f1c0370: creating. Sep 04 16:00:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-79aff8da-4122-48f4-8019-e1b7ca7965ec tempest-GroupSnapshotsTest-96941869 None] Group snapshot 2973eb18-62de-4131-93bc-57bc7f1c0370: creating. {{(pid=87513) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 16:00:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-79aff8da-4122-48f4-8019-e1b7ca7965ec tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-79aff8da-4122-48f4-8019-e1b7ca7965ec tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-79aff8da-4122-48f4-8019-e1b7ca7965ec tempest-GroupSnapshotsTest-96941869 None] Creating offline snapshot 30627b3b-943f-4514-89af-135f4f507c3a of volume 67bb85ea-4137-45c7-a705-1205a9521071 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:00:47 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6c3aa9-8a80-4ff6-9c5f-c23e9817e450]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79aff8da-4122-48f4-8019-e1b7ca7965ec tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:47 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071 Sep 04 16:00:47 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:48 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79aff8da-4122-48f4-8019-e1b7ca7965ec tempest-GroupSnapshotsTest-96941869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071" returned: 0 in 0.397s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79aff8da-4122-48f4-8019-e1b7ca7965ec tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.30627b3b-943f-4514-89af-135f4f507c3a 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:48 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.30627b3b-943f-4514-89af-135f4f507c3a 1G Sep 04 16:00:48 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:48 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79aff8da-4122-48f4-8019-e1b7ca7965ec tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.30627b3b-943f-4514-89af-135f4f507c3a 1G" returned: 0 in 0.519s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79aff8da-4122-48f4-8019-e1b7ca7965ec tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67bb85ea-4137-45c7-a705-1205a9521071 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.30627b3b-943f-4514-89af-135f4f507c3a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:48 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67bb85ea-4137-45c7-a705-1205a9521071 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.30627b3b-943f-4514-89af-135f4f507c3a Sep 04 16:00:48 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:49 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79aff8da-4122-48f4-8019-e1b7ca7965ec tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67bb85ea-4137-45c7-a705-1205a9521071 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.30627b3b-943f-4514-89af-135f4f507c3a" returned: 0 in 0.338s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:49 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-79aff8da-4122-48f4-8019-e1b7ca7965ec tempest-GroupSnapshotsTest-96941869 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.30627b3b-943f-4514-89af-135f4f507c3a is being set with open permissions: ugo+rw: NotImplementedError Sep 04 16:00:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79aff8da-4122-48f4-8019-e1b7ca7965ec tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.30627b3b-943f-4514-89af-135f4f507c3a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:49 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.30627b3b-943f-4514-89af-135f4f507c3a Sep 04 16:00:49 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:49 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79aff8da-4122-48f4-8019-e1b7ca7965ec tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.30627b3b-943f-4514-89af-135f4f507c3a" returned: 0 in 0.304s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79aff8da-4122-48f4-8019-e1b7ca7965ec tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:49 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.info Sep 04 16:00:49 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:49 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79aff8da-4122-48f4-8019-e1b7ca7965ec tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.info" returned: 0 in 0.290s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:49 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-79aff8da-4122-48f4-8019-e1b7ca7965ec tempest-GroupSnapshotsTest-96941869 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 16:00:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79aff8da-4122-48f4-8019-e1b7ca7965ec tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:49 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.info Sep 04 16:00:49 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:49 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79aff8da-4122-48f4-8019-e1b7ca7965ec tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.info" returned: 0 in 0.272s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-79aff8da-4122-48f4-8019-e1b7ca7965ec tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.207s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:49 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-79aff8da-4122-48f4-8019-e1b7ca7965ec tempest-GroupSnapshotsTest-96941869 None] group_snapshot 2973eb18-62de-4131-93bc-57bc7f1c0370: created successfully Sep 04 16:00:51 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] group_snapshot 2973eb18-62de-4131-93bc-57bc7f1c0370: deleting Sep 04 16:00:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] group_snapshot 2973eb18-62de-4131-93bc-57bc7f1c0370: deleting {{(pid=87513) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 16:00:51 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "cinder-quobyte-67bb85ea-4137-45c7-a705-1205a9521071" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:51 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-67bb85ea-4137-45c7-a705-1205a9521071" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:51 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "cinder-quobyte-30627b3b-943f-4514-89af-135f4f507c3a" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:51 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-30627b3b-943f-4514-89af-135f4f507c3a" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] Deleting offline snapshot 30627b3b-943f-4514-89af-135f4f507c3a of volume 67bb85ea-4137-45c7-a705-1205a9521071 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:00:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] snapshot_file for this snap is: volume-67bb85ea-4137-45c7-a705-1205a9521071.30627b3b-943f-4514-89af-135f4f507c3a {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:00:51 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d615eaf9-06ce-46b8-9428-2c97b420a4fa]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.30627b3b-943f-4514-89af-135f4f507c3a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:51 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.30627b3b-943f-4514-89af-135f4f507c3a Sep 04 16:00:51 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:52 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.30627b3b-943f-4514-89af-135f4f507c3a" returned: 0 in 0.588s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67bb85ea-4137-45c7-a705-1205a9521071(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:00:52 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfbc468-af45-455d-a86f-cad9949c66f8]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:52 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071 Sep 04 16:00:52 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:52 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071" returned: 0 in 0.387s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.30627b3b-943f-4514-89af-135f4f507c3a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:52 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.30627b3b-943f-4514-89af-135f4f507c3a Sep 04 16:00:52 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:53 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.30627b3b-943f-4514-89af-135f4f507c3a" returned: 0 in 0.455s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.30627b3b-943f-4514-89af-135f4f507c3a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:53 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.30627b3b-943f-4514-89af-135f4f507c3a Sep 04 16:00:53 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:53 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071.30627b3b-943f-4514-89af-135f4f507c3a" returned: 0 in 0.271s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:53 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-30627b3b-943f-4514-89af-135f4f507c3a" released by "_delete_snapshot" :: held 1.848s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:53 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-67bb85ea-4137-45c7-a705-1205a9521071" released by "delete_snapshot" :: held 1.899s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:53 devstack cinder-volume[87513]: WARNING cinder.quota [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2076897430 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2076897430, it is now deprecated. Please use the default quota class for default quota. Sep 04 16:00:53 devstack cinder-volume[87513]: WARNING cinder.quota [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2076897430 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2076897430, it is now deprecated. Please use the default quota class for default quota. Sep 04 16:00:53 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] Created reservations ['28ffb9e1-b537-4e13-8898-3a54d76aa7e0', 'a9a48945-d224-4064-ad63-8c8112e5c63b', 'a7f5ed51-e417-4b74-b545-4c777cdcdee9', '8dd6f6ad-49b5-4149-bb2e-c18fecd36a7b'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:00:53 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ce051f90-ab9e-4490-bd69-1ef3712c6c7c tempest-GroupSnapshotsTest-96941869 None] group_snapshot 2973eb18-62de-4131-93bc-57bc7f1c0370: deleted successfully Sep 04 16:00:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c6be928d-6edb-49ea-871c-407225a8d8c5 tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "cinder-quobyte-67bb85ea-4137-45c7-a705-1205a9521071" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c6be928d-6edb-49ea-871c-407225a8d8c5 tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-67bb85ea-4137-45c7-a705-1205a9521071" acquired by "delete_volume" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3660e6e1-2c99-4ff7-90dd-7e2063ea5acb tempest-VolumesActionsTest-127509361 None] Acquiring lock "cinder-77a9663b-0578-444b-96f5-56da098fcfc0" by "attach_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:54 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a2d98b-7804-449d-9744-785226a66053]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c6be928d-6edb-49ea-871c-407225a8d8c5 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3660e6e1-2c99-4ff7-90dd-7e2063ea5acb tempest-VolumesActionsTest-127509361 None] Lock "cinder-77a9663b-0578-444b-96f5-56da098fcfc0" acquired by "attach_volume" :: waited 0.036s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:54 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-3660e6e1-2c99-4ff7-90dd-7e2063ea5acb tempest-VolumesActionsTest-127509361 None] Attaching volume 77a9663b-0578-444b-96f5-56da098fcfc0 to instance e1ba8dcf-e62e-4302-ac85-06f680a559e6 at mountpoint /dev/vdb on host None. Sep 04 16:00:54 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-3660e6e1-2c99-4ff7-90dd-7e2063ea5acb tempest-VolumesActionsTest-127509361 None] Attach volume completed successfully. Sep 04 16:00:54 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071 Sep 04 16:00:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3660e6e1-2c99-4ff7-90dd-7e2063ea5acb tempest-VolumesActionsTest-127509361 None] Lock "cinder-77a9663b-0578-444b-96f5-56da098fcfc0" released by "attach_volume" :: held 0.109s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:54 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-86ed2fc1-3ba7-4118-840c-f51f2023332b tempest-VolumesActionsTest-127509361 None] Acquiring lock "cinder-77a9663b-0578-444b-96f5-56da098fcfc0-detach_volume" by "detach_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-86ed2fc1-3ba7-4118-840c-f51f2023332b tempest-VolumesActionsTest-127509361 None] Lock "cinder-77a9663b-0578-444b-96f5-56da098fcfc0-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:54 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-86ed2fc1-3ba7-4118-840c-f51f2023332b tempest-VolumesActionsTest-127509361 None] Detaching volume 77a9663b-0578-444b-96f5-56da098fcfc0 from instance e1ba8dcf-e62e-4302-ac85-06f680a559e6. Sep 04 16:00:54 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-86ed2fc1-3ba7-4118-840c-f51f2023332b tempest-VolumesActionsTest-127509361 None] Detach volume completed successfully. Sep 04 16:00:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-86ed2fc1-3ba7-4118-840c-f51f2023332b tempest-VolumesActionsTest-127509361 None] Lock "cinder-77a9663b-0578-444b-96f5-56da098fcfc0-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:54 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c6be928d-6edb-49ea-871c-407225a8d8c5 tempest-GroupSnapshotsTest-96941869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071" returned: 0 in 0.466s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c6be928d-6edb-49ea-871c-407225a8d8c5 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:54 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071 Sep 04 16:00:54 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:55 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c6be928d-6edb-49ea-871c-407225a8d8c5 tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67bb85ea-4137-45c7-a705-1205a9521071" returned: 0 in 0.398s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c6be928d-6edb-49ea-871c-407225a8d8c5 tempest-GroupSnapshotsTest-96941869 None] Lock "cinder-quobyte-67bb85ea-4137-45c7-a705-1205a9521071" released by "delete_volume" :: held 0.966s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:55 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-c6be928d-6edb-49ea-871c-407225a8d8c5 tempest-GroupSnapshotsTest-96941869 None] Created reservations ['ab11b95d-f003-4593-872c-78dfb898f03f'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:00:55 devstack cinder-volume[87513]: WARNING cinder.quota [None req-c6be928d-6edb-49ea-871c-407225a8d8c5 tempest-GroupSnapshotsTest-96941869 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2076897430 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2076897430, it is now deprecated. Please use the default quota class for default quota. Sep 04 16:00:55 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-c6be928d-6edb-49ea-871c-407225a8d8c5 tempest-GroupSnapshotsTest-96941869 None] Created reservations ['e0d03dc9-0852-4a19-b56b-287729f4d70e', 'a03c6b5a-b725-47d0-9fd7-df8bc31f4bed', '0e837fe3-5b89-425c-976a-8a8806be2982', '6258a99f-aff4-46e2-85d9-a924c4a1f5b5'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:00:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c6be928d-6edb-49ea-871c-407225a8d8c5 tempest-GroupSnapshotsTest-96941869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c6be928d-6edb-49ea-871c-407225a8d8c5 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c6be928d-6edb-49ea-871c-407225a8d8c5 tempest-GroupSnapshotsTest-96941869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:00:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c6be928d-6edb-49ea-871c-407225a8d8c5 tempest-GroupSnapshotsTest-96941869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:00:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c6be928d-6edb-49ea-871c-407225a8d8c5 tempest-GroupSnapshotsTest-96941869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c6be928d-6edb-49ea-871c-407225a8d8c5 tempest-GroupSnapshotsTest-96941869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:55 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:00:55 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:55 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c6be928d-6edb-49ea-871c-407225a8d8c5 tempest-GroupSnapshotsTest-96941869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.286s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:55 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-c6be928d-6edb-49ea-871c-407225a8d8c5 tempest-GroupSnapshotsTest-96941869 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:00:55 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-c6be928d-6edb-49ea-871c-407225a8d8c5 tempest-GroupSnapshotsTest-96941869 None] Delete group completed successfully. Sep 04 16:01:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-cedf11e3-e4fa-4230-9bb5-c583ab712925 tempest-VolumesActionsTest-127509361 None] Acquiring lock "cinder-77a9663b-0578-444b-96f5-56da098fcfc0" by "attach_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-cedf11e3-e4fa-4230-9bb5-c583ab712925 tempest-VolumesActionsTest-127509361 None] Lock "cinder-77a9663b-0578-444b-96f5-56da098fcfc0" acquired by "attach_volume" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:05 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-cedf11e3-e4fa-4230-9bb5-c583ab712925 tempest-VolumesActionsTest-127509361 None] Attaching volume 77a9663b-0578-444b-96f5-56da098fcfc0 to instance 7e6845b0-d00d-40dd-92a5-4f5c3b61c4a7 at mountpoint /dev/vdb on host None. Sep 04 16:01:05 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-cedf11e3-e4fa-4230-9bb5-c583ab712925 tempest-VolumesActionsTest-127509361 None] Attach volume completed successfully. Sep 04 16:01:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-cedf11e3-e4fa-4230-9bb5-c583ab712925 tempest-VolumesActionsTest-127509361 None] Lock "cinder-77a9663b-0578-444b-96f5-56da098fcfc0" released by "attach_volume" :: held 0.100s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-79e1d807-aa32-4ea1-82d0-631ab0c6fae6 tempest-VolumesActionsTest-127509361 None] Acquiring lock "cinder-77a9663b-0578-444b-96f5-56da098fcfc0-detach_volume" by "detach_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-79e1d807-aa32-4ea1-82d0-631ab0c6fae6 tempest-VolumesActionsTest-127509361 None] Lock "cinder-77a9663b-0578-444b-96f5-56da098fcfc0-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:05 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-79e1d807-aa32-4ea1-82d0-631ab0c6fae6 tempest-VolumesActionsTest-127509361 None] Detaching volume 77a9663b-0578-444b-96f5-56da098fcfc0 from instance 7e6845b0-d00d-40dd-92a5-4f5c3b61c4a7. Sep 04 16:01:05 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-79e1d807-aa32-4ea1-82d0-631ab0c6fae6 tempest-VolumesActionsTest-127509361 None] Detach volume completed successfully. Sep 04 16:01:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-79e1d807-aa32-4ea1-82d0-631ab0c6fae6 tempest-VolumesActionsTest-127509361 None] Lock "cinder-77a9663b-0578-444b-96f5-56da098fcfc0-detach_volume" released by "detach_volume" :: held 0.067s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4871f000-ad4d-41de-8d0e-3570c37b84cc tempest-VolumesActionsTest-127509361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4871f000-ad4d-41de-8d0e-3570c37b84cc tempest-VolumesActionsTest-127509361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:09 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0a6204-cb4d-4e60-b330-fe1c66fa70e4]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4871f000-ad4d-41de-8d0e-3570c37b84cc tempest-VolumesActionsTest-127509361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:09 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 Sep 04 16:01:09 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:10 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4871f000-ad4d-41de-8d0e-3570c37b84cc tempest-VolumesActionsTest-127509361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0" returned: 0 in 0.370s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:10 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a1d05c-8b80-4816-8bb9-5dc7dcec6bdf]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4871f000-ad4d-41de-8d0e-3570c37b84cc tempest-VolumesActionsTest-127509361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:10 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 Sep 04 16:01:10 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:10 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4871f000-ad4d-41de-8d0e-3570c37b84cc tempest-VolumesActionsTest-127509361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0" returned: 0 in 0.434s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4871f000-ad4d-41de-8d0e-3570c37b84cc tempest-VolumesActionsTest-127509361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 /opt/stack/data/cinder/conversion/77a9663b-0578-444b-96f5-56da098fcfc0.temp_image.f0c8757e-156f-4087-9c9a-2c8cff684b2f7xsy2pur.img {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:10 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 /opt/stack/data/cinder/conversion/77a9663b-0578-444b-96f5-56da098fcfc0.temp_image.f0c8757e-156f-4087-9c9a-2c8cff684b2f7xsy2pur.img Sep 04 16:01:10 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:15 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4871f000-ad4d-41de-8d0e-3570c37b84cc tempest-VolumesActionsTest-127509361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 /opt/stack/data/cinder/conversion/77a9663b-0578-444b-96f5-56da098fcfc0.temp_image.f0c8757e-156f-4087-9c9a-2c8cff684b2f7xsy2pur.img" returned: 0 in 4.669s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:15 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faf7359-ca38-4cb3-ad19-735d2116870c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4871f000-ad4d-41de-8d0e-3570c37b84cc tempest-VolumesActionsTest-127509361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:15 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 Sep 04 16:01:15 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:15 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=101,cinder:SELECT=101,cinder:INSERT=26,cinder:DELETE=5 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:01:15 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4871f000-ad4d-41de-8d0e-3570c37b84cc tempest-VolumesActionsTest-127509361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0" returned: 0 in 0.589s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:15 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-4871f000-ad4d-41de-8d0e-3570c37b84cc tempest-VolumesActionsTest-127509361 None] Image conversion details: src /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0, size 1024.00 MB, duration 4.67 sec, destination /opt/stack/data/cinder/conversion/77a9663b-0578-444b-96f5-56da098fcfc0.temp_image.f0c8757e-156f-4087-9c9a-2c8cff684b2f7xsy2pur.img {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:01:15 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-4871f000-ad4d-41de-8d0e-3570c37b84cc tempest-VolumesActionsTest-127509361 None] Converted 1024.00 MB image at 219.28 MB/s Sep 04 16:01:15 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-4871f000-ad4d-41de-8d0e-3570c37b84cc tempest-VolumesActionsTest-127509361 None] f0c8757e-156f-4087-9c9a-2c8cff684b2f was raw, no need to convert to raw {{(pid=87513) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 04 16:01:20 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:01:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Flow 'volume_create_manager' (002dd923-5c4e-41be-98cc-66dfc0eedd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:01:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f88599-0ab7-4722-9c9e-8aa0470ef0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f88599-0ab7-4722-9c9e-8aa0470ef0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1156050715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e654682c-c795-4bad-979a-69b8597f3278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2096dfb90c42b18a90ff969d070f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:01:20Z,use_quota=True,user_id='4e28336c55a748f0b776c36d30eb0fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(871cb6fa-7f3f-4979-a578-f5bbf61fd608),volume_type_id=871cb6fa-7f3f-4979-a578-f5bbf61fd608)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b98a27-6402-412b-ac7f-7ef3777f45a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b98a27-6402-412b-ac7f-7ef3777f45a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49130949-d6fb-4d0e-a7a4-885db6a46b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49130949-d6fb-4d0e-a7a4-885db6a46b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e654682c-c795-4bad-979a-69b8597f3278', 'volume_name': 'volume-e654682c-c795-4bad-979a-69b8597f3278', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c559ef-1d5c-4b6e-983e-bf7cd461776e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c559ef-1d5c-4b6e-983e-bf7cd461776e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b02c89-c33c-40c7-95fb-6697cdb442e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:20 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Volume e654682c-c795-4bad-979a-69b8597f3278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e654682c-c795-4bad-979a-69b8597f3278', 'volume_size': 1} Sep 04 16:01:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:30 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=1 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:01:30 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=98,cinder:INSERT=21,cinder:DELETE=3,cinder:SELECT=103 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:01:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:01:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:01:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:01:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:34 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:01:34 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:35 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4871f000-ad4d-41de-8d0e-3570c37b84cc tempest-VolumesActionsTest-127509361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.414s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4871f000-ad4d-41de-8d0e-3570c37b84cc tempest-VolumesActionsTest-127509361 None] Uploaded volume to glance image-id: f0c8757e-156f-4087-9c9a-2c8cff684b2f. {{(pid=87513) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 04 16:01:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.147s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1156050715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e654682c-c795-4bad-979a-69b8597f3278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2096dfb90c42b18a90ff969d070f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:01:20Z,use_quota=True,user_id='4e28336c55a748f0b776c36d30eb0fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(871cb6fa-7f3f-4979-a578-f5bbf61fd608),volume_type_id=871cb6fa-7f3f-4979-a578-f5bbf61fd608)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:01:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Creating volume e654682c-c795-4bad-979a-69b8597f3278 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:01:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:01:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:01:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:01:35 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:01:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e654682c-c795-4bad-979a-69b8597f3278 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.373s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:01:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:01:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 28 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:01:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 16:01:35 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e654682c-c795-4bad-979a-69b8597f3278 1073741824 Sep 04 16:01:35 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:35 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-4871f000-ad4d-41de-8d0e-3570c37b84cc tempest-VolumesActionsTest-127509361 None] Copy volume to image completed successfully. Sep 04 16:01:35 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e654682c-c795-4bad-979a-69b8597f3278 1073741824" returned: 0 in 0.436s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e654682c-c795-4bad-979a-69b8597f3278 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:35 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e654682c-c795-4bad-979a-69b8597f3278 Sep 04 16:01:35 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:36 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e654682c-c795-4bad-979a-69b8597f3278" returned: 0 in 0.302s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:36 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:01:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:36 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b02c89-c33c-40c7-95fb-6697cdb442e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e654682c-c795-4bad-979a-69b8597f3278', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:36 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd4b355-aad6-4929-bbf7-9f9d28bb2f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:36 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Volume volume-e654682c-c795-4bad-979a-69b8597f3278 (e654682c-c795-4bad-979a-69b8597f3278): created successfully Sep 04 16:01:36 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd4b355-aad6-4929-bbf7-9f9d28bb2f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:36 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Flow 'volume_create_manager' (002dd923-5c4e-41be-98cc-66dfc0eedd39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:01:36 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-6edba4a2-50db-46d2-b7a1-8b0537245031 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Created volume successfully. Sep 04 16:01:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:36 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a491fd-257b-41e8-9ab2-e3fff90b8e25]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:36 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 Sep 04 16:01:36 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:37 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0" returned: 0 in 0.396s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:37 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5fe11a-661e-4166-ac5e-07c2b31e98d2]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:37 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 Sep 04 16:01:37 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-57f17dda-af25-49fa-9c82-b38e5e3cd3d9 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-57f17dda-af25-49fa-9c82-b38e5e3cd3d9 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-57f17dda-af25-49fa-9c82-b38e5e3cd3d9 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:01:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-57f17dda-af25-49fa-9c82-b38e5e3cd3d9 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:01:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-57f17dda-af25-49fa-9c82-b38e5e3cd3d9 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-57f17dda-af25-49fa-9c82-b38e5e3cd3d9 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:37 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0" returned: 0 in 0.411s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 /opt/stack/data/cinder/conversion/77a9663b-0578-444b-96f5-56da098fcfc0.temp_image.e663d4ff-ded6-433f-8790-0e58bb04024cromugijz.img {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:37 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:01:37 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:37 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 /opt/stack/data/cinder/conversion/77a9663b-0578-444b-96f5-56da098fcfc0.temp_image.e663d4ff-ded6-433f-8790-0e58bb04024cromugijz.img Sep 04 16:01:37 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:37 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-57f17dda-af25-49fa-9c82-b38e5e3cd3d9 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.275s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:37 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-57f17dda-af25-49fa-9c82-b38e5e3cd3d9 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:01:37 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-57f17dda-af25-49fa-9c82-b38e5e3cd3d9 tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Retype volume completed successfully. Sep 04 16:01:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Acquiring lock "cinder-e654682c-c795-4bad-979a-69b8597f3278-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Lock "cinder-e654682c-c795-4bad-979a-69b8597f3278-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Acquiring lock "cinder-quobyte-e654682c-c795-4bad-979a-69b8597f3278" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Lock "cinder-quobyte-e654682c-c795-4bad-979a-69b8597f3278" acquired by "delete_volume" :: waited 0.043s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:39 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8f7dd0-1eb6-46cc-aa9e-a6341a7b429b]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e654682c-c795-4bad-979a-69b8597f3278 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:39 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e654682c-c795-4bad-979a-69b8597f3278 Sep 04 16:01:39 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:40 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e654682c-c795-4bad-979a-69b8597f3278" returned: 0 in 0.745s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e654682c-c795-4bad-979a-69b8597f3278 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:40 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e654682c-c795-4bad-979a-69b8597f3278 Sep 04 16:01:40 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:41 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e654682c-c795-4bad-979a-69b8597f3278" returned: 0 in 0.581s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Lock "cinder-quobyte-e654682c-c795-4bad-979a-69b8597f3278" released by "delete_volume" :: held 1.416s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:41 devstack cinder-volume[87513]: WARNING cinder.quota [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 04 16:01:41 devstack cinder-volume[87513]: WARNING cinder.quota [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 04 16:01:41 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Created reservations ['2c1a6e18-d954-4156-94cb-960cfce632d9', 'ca3dccf1-eb38-4322-8b82-c2d18236e73a', 'b9c9102a-96a8-4c97-a93d-2204beb391c7', '449f228f-fd34-45a6-bd8c-3c8fb2a83ff9'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:01:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:41 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:01:41 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:01:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:41 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:01:41 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:41 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 /opt/stack/data/cinder/conversion/77a9663b-0578-444b-96f5-56da098fcfc0.temp_image.e663d4ff-ded6-433f-8790-0e58bb04024cromugijz.img" returned: 0 in 4.193s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:41 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[4234e848-df0f-46c0-bd07-7fb88a304822]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:41 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.471s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:41 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:01:41 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Deleted volume successfully. Sep 04 16:01:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ba9c8e2d-00ae-4d73-a400-929b169ca0fa tempest-VolumeRetypeWithoutMigrationTest-1494901702 None] Lock "cinder-e654682c-c795-4bad-979a-69b8597f3278-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:41 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 Sep 04 16:01:41 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:42 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0" returned: 0 in 0.540s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:42 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] Image conversion details: src /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0, size 1024.00 MB, duration 4.20 sec, destination /opt/stack/data/cinder/conversion/77a9663b-0578-444b-96f5-56da098fcfc0.temp_image.e663d4ff-ded6-433f-8790-0e58bb04024cromugijz.img {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:01:42 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] Converted 1024.00 MB image at 243.96 MB/s Sep 04 16:01:42 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] e663d4ff-ded6-433f-8790-0e58bb04024c was raw, converting to qcow2 {{(pid=87513) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 04 16:01:42 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[429fbfe2-beeb-4cc9-a0b7-5c16e1b349ae]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/77a9663b-0578-444b-96f5-56da098fcfc0.temp_image.e663d4ff-ded6-433f-8790-0e58bb04024cromugijz.img {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:42 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/77a9663b-0578-444b-96f5-56da098fcfc0.temp_image.e663d4ff-ded6-433f-8790-0e58bb04024cromugijz.img Sep 04 16:01:42 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:42 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/77a9663b-0578-444b-96f5-56da098fcfc0.temp_image.e663d4ff-ded6-433f-8790-0e58bb04024cromugijz.img" returned: 0 in 0.340s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/77a9663b-0578-444b-96f5-56da098fcfc0.temp_image.e663d4ff-ded6-433f-8790-0e58bb04024cromugijz.img {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:42 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/77a9663b-0578-444b-96f5-56da098fcfc0.temp_image.e663d4ff-ded6-433f-8790-0e58bb04024cromugijz.img Sep 04 16:01:42 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:43 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/77a9663b-0578-444b-96f5-56da098fcfc0.temp_image.e663d4ff-ded6-433f-8790-0e58bb04024cromugijz.img" returned: 1 in 0.362s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/77a9663b-0578-444b-96f5-56da098fcfc0.temp_image.e663d4ff-ded6-433f-8790-0e58bb04024cromugijz.img' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:01:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/77a9663b-0578-444b-96f5-56da098fcfc0.temp_image.e663d4ff-ded6-433f-8790-0e58bb04024cromugijz.img /opt/stack/data/cinder/conversion/vol_upload_p6s1nyi8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:43 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/77a9663b-0578-444b-96f5-56da098fcfc0.temp_image.e663d4ff-ded6-433f-8790-0e58bb04024cromugijz.img /opt/stack/data/cinder/conversion/vol_upload_p6s1nyi8 Sep 04 16:01:43 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:43 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/77a9663b-0578-444b-96f5-56da098fcfc0.temp_image.e663d4ff-ded6-433f-8790-0e58bb04024cromugijz.img /opt/stack/data/cinder/conversion/vol_upload_p6s1nyi8" returned: 0 in 0.263s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:43 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] Image conversion details: src /opt/stack/data/cinder/conversion/77a9663b-0578-444b-96f5-56da098fcfc0.temp_image.e663d4ff-ded6-433f-8790-0e58bb04024cromugijz.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_p6s1nyi8 {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:01:43 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 04 16:01:43 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c532b06c-dda5-49dc-8763-e63828d31301]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_p6s1nyi8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:43 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_p6s1nyi8 Sep 04 16:01:43 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:43 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_p6s1nyi8" returned: 0 in 0.363s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.451s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:45 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] Uploaded volume to glance image-id: e663d4ff-ded6-433f-8790-0e58bb04024c. {{(pid=87513) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 04 16:01:45 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-922090e5-5556-492d-a123-5b8583ff0828 tempest-VolumesActionsTest-127509361 None] Copy volume to image completed successfully. Sep 04 16:01:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-170aa283-5627-455b-9a2b-a9767e7792c1 tempest-VolumesActionsTest-127509361 None] Acquiring lock "cinder-77a9663b-0578-444b-96f5-56da098fcfc0-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-170aa283-5627-455b-9a2b-a9767e7792c1 tempest-VolumesActionsTest-127509361 None] Lock "cinder-77a9663b-0578-444b-96f5-56da098fcfc0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-170aa283-5627-455b-9a2b-a9767e7792c1 tempest-VolumesActionsTest-127509361 None] Acquiring lock "cinder-quobyte-77a9663b-0578-444b-96f5-56da098fcfc0" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-170aa283-5627-455b-9a2b-a9767e7792c1 tempest-VolumesActionsTest-127509361 None] Lock "cinder-quobyte-77a9663b-0578-444b-96f5-56da098fcfc0" acquired by "delete_volume" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:46 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9146531-a159-483b-8eee-7edf56fc52b5]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-170aa283-5627-455b-9a2b-a9767e7792c1 tempest-VolumesActionsTest-127509361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:47 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 Sep 04 16:01:47 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:47 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-170aa283-5627-455b-9a2b-a9767e7792c1 tempest-VolumesActionsTest-127509361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0" returned: 0 in 0.361s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-170aa283-5627-455b-9a2b-a9767e7792c1 tempest-VolumesActionsTest-127509361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:47 devstack sudo[101079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0 Sep 04 16:01:47 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:47 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-170aa283-5627-455b-9a2b-a9767e7792c1 tempest-VolumesActionsTest-127509361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-77a9663b-0578-444b-96f5-56da098fcfc0" returned: 0 in 0.255s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-170aa283-5627-455b-9a2b-a9767e7792c1 tempest-VolumesActionsTest-127509361 None] Lock "cinder-quobyte-77a9663b-0578-444b-96f5-56da098fcfc0" released by "delete_volume" :: held 0.659s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:47 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-170aa283-5627-455b-9a2b-a9767e7792c1 tempest-VolumesActionsTest-127509361 None] Created reservations ['6f8497f3-9fbc-4489-9907-c4523c8369d0', '2c5214a7-3106-4466-8b38-e92e2d731896', 'f8016c4c-d953-41b2-a835-08ad99d6ea10', '6e39bfcb-1678-4e17-8773-5f41febf3002'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:01:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-170aa283-5627-455b-9a2b-a9767e7792c1 tempest-VolumesActionsTest-127509361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-170aa283-5627-455b-9a2b-a9767e7792c1 tempest-VolumesActionsTest-127509361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-170aa283-5627-455b-9a2b-a9767e7792c1 tempest-VolumesActionsTest-127509361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:01:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-170aa283-5627-455b-9a2b-a9767e7792c1 tempest-VolumesActionsTest-127509361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:01:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-170aa283-5627-455b-9a2b-a9767e7792c1 tempest-VolumesActionsTest-127509361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-170aa283-5627-455b-9a2b-a9767e7792c1 tempest-VolumesActionsTest-127509361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:47 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:01:47 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:48 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-170aa283-5627-455b-9a2b-a9767e7792c1 tempest-VolumesActionsTest-127509361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.311s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:48 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-170aa283-5627-455b-9a2b-a9767e7792c1 tempest-VolumesActionsTest-127509361 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:01:48 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-170aa283-5627-455b-9a2b-a9767e7792c1 tempest-VolumesActionsTest-127509361 None] Deleted volume successfully. Sep 04 16:01:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-170aa283-5627-455b-9a2b-a9767e7792c1 tempest-VolumesActionsTest-127509361 None] Lock "cinder-77a9663b-0578-444b-96f5-56da098fcfc0-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Flow 'volume_create_manager' (8e4631ff-da04-4665-b189-3639415ac71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4520a52-48cc-4f07-9fce-e23a099a73f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4520a52-48cc-4f07-9fce-e23a099a73f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-212152990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10344da1-3ce1-45a7-b60a-bcefc9336ef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caefb73af6e041f3b1d75892cd7ade1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:01:51Z,use_quota=True,user_id='bca3175e88a04511b276561c5ed2f7c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2be4d12-75f9-4510-9d87-503b828268c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2be4d12-75f9-4510-9d87-503b828268c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54f4e6e-4829-4063-bd4e-a16fb00f979e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54f4e6e-4829-4063-bd4e-a16fb00f979e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10344da1-3ce1-45a7-b60a-bcefc9336ef0', 'volume_name': 'volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff5a657-ba11-472d-a01f-aa3fa6fbb8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff5a657-ba11-472d-a01f-aa3fa6fbb8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db32f9ba-c6fd-4bcb-b425-b8e7101cca5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:51 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Volume 10344da1-3ce1-45a7-b60a-bcefc9336ef0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0', 'volume_size': 1} Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-212152990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10344da1-3ce1-45a7-b60a-bcefc9336ef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caefb73af6e041f3b1d75892cd7ade1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:01:51Z,use_quota=True,user_id='bca3175e88a04511b276561c5ed2f7c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Creating volume 10344da1-3ce1-45a7-b60a-bcefc9336ef0 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:01:51 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:01:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:51 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0 1073741824 Sep 04 16:01:51 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:52 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0 1073741824" returned: 0 in 0.471s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:52 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0 Sep 04 16:01:52 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:52 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0" returned: 0 in 0.351s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:01:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db32f9ba-c6fd-4bcb-b425-b8e7101cca5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb35cb0e-76da-47d4-8d74-57376acbb5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:52 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Volume volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0 (10344da1-3ce1-45a7-b60a-bcefc9336ef0): created successfully Sep 04 16:01:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb35cb0e-76da-47d4-8d74-57376acbb5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Flow 'volume_create_manager' (8e4631ff-da04-4665-b189-3639415ac71f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:01:52 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-452e6c70-295c-454a-b37c-94713358edaa tempest-SnapshotMetadataTestJSON-1873244735 None] Created volume successfully. Sep 04 16:01:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7b42cbde-e5ce-4c1f-919d-1ef08bf4457f tempest-SnapshotMetadataTestJSON-1873244735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7b42cbde-e5ce-4c1f-919d-1ef08bf4457f tempest-SnapshotMetadataTestJSON-1873244735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:53 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-7b42cbde-e5ce-4c1f-919d-1ef08bf4457f tempest-SnapshotMetadataTestJSON-1873244735 None] Creating offline snapshot 69bdb740-d0b3-4536-8271-d3f4e41796a3 of volume 10344da1-3ce1-45a7-b60a-bcefc9336ef0 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:01:53 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f272d8-3f25-4d23-913c-dfd9237cc7fc]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7b42cbde-e5ce-4c1f-919d-1ef08bf4457f tempest-SnapshotMetadataTestJSON-1873244735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:53 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0 Sep 04 16:01:53 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:54 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7b42cbde-e5ce-4c1f-919d-1ef08bf4457f tempest-SnapshotMetadataTestJSON-1873244735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0" returned: 0 in 0.380s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7b42cbde-e5ce-4c1f-919d-1ef08bf4457f tempest-SnapshotMetadataTestJSON-1873244735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.69bdb740-d0b3-4536-8271-d3f4e41796a3 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:54 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.69bdb740-d0b3-4536-8271-d3f4e41796a3 1G Sep 04 16:01:54 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:54 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7b42cbde-e5ce-4c1f-919d-1ef08bf4457f tempest-SnapshotMetadataTestJSON-1873244735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.69bdb740-d0b3-4536-8271-d3f4e41796a3 1G" returned: 0 in 0.476s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7b42cbde-e5ce-4c1f-919d-1ef08bf4457f tempest-SnapshotMetadataTestJSON-1873244735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.69bdb740-d0b3-4536-8271-d3f4e41796a3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:54 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.69bdb740-d0b3-4536-8271-d3f4e41796a3 Sep 04 16:01:54 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:54 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:01:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Flow 'volume_create_manager' (c185f746-48be-4e18-aba4-4ba4d3684f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:01:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a706a3e-d3e4-4114-96ca-19f0419257f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:54 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7b42cbde-e5ce-4c1f-919d-1ef08bf4457f tempest-SnapshotMetadataTestJSON-1873244735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.69bdb740-d0b3-4536-8271-d3f4e41796a3" returned: 0 in 0.342s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:54 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-7b42cbde-e5ce-4c1f-919d-1ef08bf4457f tempest-SnapshotMetadataTestJSON-1873244735 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.69bdb740-d0b3-4536-8271-d3f4e41796a3 is being set with open permissions: ugo+rw Sep 04 16:01:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7b42cbde-e5ce-4c1f-919d-1ef08bf4457f tempest-SnapshotMetadataTestJSON-1873244735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.69bdb740-d0b3-4536-8271-d3f4e41796a3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a706a3e-d3e4-4114-96ca-19f0419257f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1859008710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c20e63e-6249-476d-8251-401e84d5ae15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b18f86c3bc548abb57448d5c19f28c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:01:55Z,use_quota=True,user_id='0e4fffb9d0494e8cbac7e137f2b25f38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:54 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.69bdb740-d0b3-4536-8271-d3f4e41796a3 Sep 04 16:01:54 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f7bd1c-6568-4707-af3c-53e098d1caa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f7bd1c-6568-4707-af3c-53e098d1caa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd835154-694a-4df6-a715-b2f9013301b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd835154-694a-4df6-a715-b2f9013301b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c20e63e-6249-476d-8251-401e84d5ae15', 'volume_name': 'volume-9c20e63e-6249-476d-8251-401e84d5ae15', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea41a56-211e-44bb-be7b-6dc754a4ca2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea41a56-211e-44bb-be7b-6dc754a4ca2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17db3ff-6205-4897-8c88-488f204cb26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:54 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Volume 9c20e63e-6249-476d-8251-401e84d5ae15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c20e63e-6249-476d-8251-401e84d5ae15', 'volume_size': 1} Sep 04 16:01:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:55 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7b42cbde-e5ce-4c1f-919d-1ef08bf4457f tempest-SnapshotMetadataTestJSON-1873244735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.69bdb740-d0b3-4536-8271-d3f4e41796a3" returned: 0 in 0.246s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7b42cbde-e5ce-4c1f-919d-1ef08bf4457f tempest-SnapshotMetadataTestJSON-1873244735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:55 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.info Sep 04 16:01:55 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:55 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7b42cbde-e5ce-4c1f-919d-1ef08bf4457f tempest-SnapshotMetadataTestJSON-1873244735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.info" returned: 0 in 0.240s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:55 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-7b42cbde-e5ce-4c1f-919d-1ef08bf4457f tempest-SnapshotMetadataTestJSON-1873244735 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.info is being set with open permissions: ugo+rw Sep 04 16:01:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7b42cbde-e5ce-4c1f-919d-1ef08bf4457f tempest-SnapshotMetadataTestJSON-1873244735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:55 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.info Sep 04 16:01:55 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:55 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7b42cbde-e5ce-4c1f-919d-1ef08bf4457f tempest-SnapshotMetadataTestJSON-1873244735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.info" returned: 0 in 0.239s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7b42cbde-e5ce-4c1f-919d-1ef08bf4457f tempest-SnapshotMetadataTestJSON-1873244735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.013s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.718s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1859008710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c20e63e-6249-476d-8251-401e84d5ae15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b18f86c3bc548abb57448d5c19f28c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:01:55Z,use_quota=True,user_id='0e4fffb9d0494e8cbac7e137f2b25f38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:01:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Creating volume 9c20e63e-6249-476d-8251-401e84d5ae15 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:01:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:01:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:01:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:01:55 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:01:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:55 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15 1073741824 Sep 04 16:01:55 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:55 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-7b42cbde-e5ce-4c1f-919d-1ef08bf4457f tempest-SnapshotMetadataTestJSON-1873244735 None] Create snapshot completed successfully Sep 04 16:01:56 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15 1073741824" returned: 0 in 0.420s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:56 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15 Sep 04 16:01:56 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:56 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15" returned: 0 in 0.244s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:01:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17db3ff-6205-4897-8c88-488f204cb26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c20e63e-6249-476d-8251-401e84d5ae15', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fae72a-0dad-43a0-ac12-c47624ee77ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:56 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Volume volume-9c20e63e-6249-476d-8251-401e84d5ae15 (9c20e63e-6249-476d-8251-401e84d5ae15): created successfully Sep 04 16:01:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fae72a-0dad-43a0-ac12-c47624ee77ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Flow 'volume_create_manager' (c185f746-48be-4e18-aba4-4ba4d3684f23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:01:56 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-6c92ff63-24fd-4631-9d7a-916c74c0d724 tempest-VolumesCloneTest-1694792786 None] Created volume successfully. Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Flow 'volume_create_manager' (0ec16b24-62d4-446f-b7b6-cbf55f6de2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1f0ada-09e0-4f9f-a8e2-4ac10091ff97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] Acquiring lock "cinder-69bdb740-d0b3-4536-8271-d3f4e41796a3-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1f0ada-09e0-4f9f-a8e2-4ac10091ff97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1051594608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c110558b-bb9d-4a02-84f1-6349de46ba5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b18f86c3bc548abb57448d5c19f28c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:01:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=9c20e63e-6249-476d-8251-401e84d5ae15,status='creating',terminated_at=None,updated_at=2026-09-04T14:01:57Z,use_quota=True,user_id='0e4fffb9d0494e8cbac7e137f2b25f38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8da5f1-b809-4353-9c43-e9cf949b14e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8da5f1-b809-4353-9c43-e9cf949b14e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381b2055-7ecc-4c71-8b90-77e0da9bf3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] Lock "cinder-69bdb740-d0b3-4536-8271-d3f4e41796a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] Acquiring lock "cinder-quobyte-10344da1-3ce1-45a7-b60a-bcefc9336ef0" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381b2055-7ecc-4c71-8b90-77e0da9bf3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c110558b-bb9d-4a02-84f1-6349de46ba5e', 'volume_name': 'volume-c110558b-bb9d-4a02-84f1-6349de46ba5e', 'volume_size': 2, 'source_volid': '9c20e63e-6249-476d-8251-401e84d5ae15', 'source_volstatus': 'available'}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2594fc7f-4f67-4dd9-b5af-6c9db796ea81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2594fc7f-4f67-4dd9-b5af-6c9db796ea81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d24ff998-6fc1-4682-b620-cd0921357b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:57 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Volume c110558b-bb9d-4a02-84f1-6349de46ba5e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c110558b-bb9d-4a02-84f1-6349de46ba5e', 'volume_size': 2, 'source_volid': '9c20e63e-6249-476d-8251-401e84d5ae15', 'source_volstatus': 'available'} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:57 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Cloning volume 9c20e63e-6249-476d-8251-401e84d5ae15 to volume c110558b-bb9d-4a02-84f1-6349de46ba5e Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] Lock "cinder-quobyte-10344da1-3ce1-45a7-b60a-bcefc9336ef0" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] Acquiring lock "cinder-quobyte-69bdb740-d0b3-4536-8271-d3f4e41796a3" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] Lock "cinder-quobyte-69bdb740-d0b3-4536-8271-d3f4e41796a3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] Deleting offline snapshot 69bdb740-d0b3-4536-8271-d3f4e41796a3 of volume 10344da1-3ce1-45a7-b60a-bcefc9336ef0 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] snapshot_file for this snap is: volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.69bdb740-d0b3-4536-8271-d3f4e41796a3 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Creating offline snapshot 4679e986-f933-4105-baa3-b6a3fd7f0f54 of volume 9c20e63e-6249-476d-8251-401e84d5ae15 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c499f4-68c5-4915-bdd6-bf99846c2a9c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.69bdb740-d0b3-4536-8271-d3f4e41796a3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b38697-da10-4314-964a-28e4b64f74ac]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:57 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.69bdb740-d0b3-4536-8271-d3f4e41796a3 Sep 04 16:01:57 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:57 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15 Sep 04 16:01:57 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:58 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.69bdb740-d0b3-4536-8271-d3f4e41796a3" returned: 0 in 0.390s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:01:58 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d162ce70-a2f4-4e4b-beca-305cfcf8b80b]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:58 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15" returned: 0 in 0.426s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:58 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54 1G Sep 04 16:01:58 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:58 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0 Sep 04 16:01:58 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:58 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0" returned: 0 in 0.381s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.69bdb740-d0b3-4536-8271-d3f4e41796a3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:58 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.69bdb740-d0b3-4536-8271-d3f4e41796a3 Sep 04 16:01:58 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:58 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54 1G" returned: 0 in 0.459s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c20e63e-6249-476d-8251-401e84d5ae15 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:58 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c20e63e-6249-476d-8251-401e84d5ae15 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54 Sep 04 16:01:58 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:58 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.69bdb740-d0b3-4536-8271-d3f4e41796a3" returned: 0 in 0.344s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.69bdb740-d0b3-4536-8271-d3f4e41796a3 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:58 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.69bdb740-d0b3-4536-8271-d3f4e41796a3 Sep 04 16:01:58 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:58 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c20e63e-6249-476d-8251-401e84d5ae15 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54" returned: 0 in 0.318s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:58 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54 is being set with open permissions: ugo+rw Sep 04 16:01:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:58 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54 Sep 04 16:01:58 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:59 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0.69bdb740-d0b3-4536-8271-d3f4e41796a3" returned: 0 in 0.262s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] Lock "cinder-quobyte-69bdb740-d0b3-4536-8271-d3f4e41796a3" released by "_delete_snapshot" :: held 1.496s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] Lock "cinder-quobyte-10344da1-3ce1-45a7-b60a-bcefc9336ef0" released by "delete_snapshot" :: held 1.520s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:59 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54" returned: 0 in 0.264s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:59 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.info Sep 04 16:01:59 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] Created reservations ['72b96930-0491-45f3-9ca5-0690e5e25986', 'fad9af96-548e-465a-b6b7-7d1fde462cfe', '57f4dd5f-e5fa-4871-aa3d-8c684880891f', '999bc5c5-2dd5-45ff-b8dc-9d73e5d59a50'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:01:59 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] Delete snapshot completed successfully. Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ea05bd4d-f2b3-4c74-a768-56ea043412e3 tempest-SnapshotMetadataTestJSON-1873244735 None] Lock "cinder-69bdb740-d0b3-4536-8271-d3f4e41796a3-delete_snapshot" released by "delete_snapshot" :: held 1.733s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:59 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.info" returned: 0 in 0.262s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:59 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.info is being set with open permissions: ugo+rw Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:59 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.info Sep 04 16:01:59 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:59 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.info" returned: 0 in 0.242s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Acquiring lock "cinder-quobyte-c110558b-bb9d-4a02-84f1-6349de46ba5e" by "_copy_volume_from_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Lock "cinder-quobyte-c110558b-bb9d-4a02-84f1-6349de46ba5e" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] snapshot: 4679e986-f933-4105-baa3-b6a3fd7f0f54, volume: c110558b-bb9d-4a02-84f1-6349de46ba5e, {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbf19259-72aa-4a18-9e64-7eee4b39b084 tempest-SnapshotMetadataTestJSON-1873244735 None] Acquiring lock "cinder-10344da1-3ce1-45a7-b60a-bcefc9336ef0-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51488d4-8cc6-4015-81c8-4eea2e09f6b6]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbf19259-72aa-4a18-9e64-7eee4b39b084 tempest-SnapshotMetadataTestJSON-1873244735 None] Lock "cinder-10344da1-3ce1-45a7-b60a-bcefc9336ef0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbf19259-72aa-4a18-9e64-7eee4b39b084 tempest-SnapshotMetadataTestJSON-1873244735 None] Acquiring lock "cinder-quobyte-10344da1-3ce1-45a7-b60a-bcefc9336ef0" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbf19259-72aa-4a18-9e64-7eee4b39b084 tempest-SnapshotMetadataTestJSON-1873244735 None] Lock "cinder-quobyte-10344da1-3ce1-45a7-b60a-bcefc9336ef0" acquired by "delete_volume" :: waited 0.021s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd09abb-0005-4c2e-8357-c9df585ef1a9]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbf19259-72aa-4a18-9e64-7eee4b39b084 tempest-SnapshotMetadataTestJSON-1873244735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:59 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54 Sep 04 16:01:59 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:00 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0 Sep 04 16:02:00 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:00 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54" returned: 0 in 0.380s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:00 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c20e63e-6249-476d-8251-401e84d5ae15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:02:00 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] will copy from snapshot at /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15 {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 04 16:02:00 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Creating direct copy from snapshot {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 04 16:02:00 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[01272672-b05c-4e32-a2c5-5352626b7d0a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:00 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbf19259-72aa-4a18-9e64-7eee4b39b084 tempest-SnapshotMetadataTestJSON-1873244735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0" returned: 0 in 0.370s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbf19259-72aa-4a18-9e64-7eee4b39b084 tempest-SnapshotMetadataTestJSON-1873244735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:00 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15 Sep 04 16:02:00 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:00 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0 Sep 04 16:02:00 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:00 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:00 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbf19259-72aa-4a18-9e64-7eee4b39b084 tempest-SnapshotMetadataTestJSON-1873244735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-10344da1-3ce1-45a7-b60a-bcefc9336ef0" returned: 0 in 0.266s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15" returned: 0 in 0.387s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:00 devstack cinder-volume[87513]: DEBUG cinder.utils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Path /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c110558b-bb9d-4a02-84f1-6349de46ba5e not found in is_blk_device check {{(pid=87513) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 04 16:02:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c110558b-bb9d-4a02-84f1-6349de46ba5e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbf19259-72aa-4a18-9e64-7eee4b39b084 tempest-SnapshotMetadataTestJSON-1873244735 None] Lock "cinder-quobyte-10344da1-3ce1-45a7-b60a-bcefc9336ef0" released by "delete_volume" :: held 0.705s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:00 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c110558b-bb9d-4a02-84f1-6349de46ba5e Sep 04 16:02:00 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:00 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-bbf19259-72aa-4a18-9e64-7eee4b39b084 tempest-SnapshotMetadataTestJSON-1873244735 None] Created reservations ['9df97e29-efe6-484f-9ef4-30bb1ab67fe5', 'bf4b024d-e106-4598-bdc3-528e2dd8812c', 'd0134973-f7fc-4aa1-8d18-3219b2058096', 'c5e684b2-a274-4c75-a702-466597f7f58f'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:02:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bbf19259-72aa-4a18-9e64-7eee4b39b084 tempest-SnapshotMetadataTestJSON-1873244735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bbf19259-72aa-4a18-9e64-7eee4b39b084 tempest-SnapshotMetadataTestJSON-1873244735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:00 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bbf19259-72aa-4a18-9e64-7eee4b39b084 tempest-SnapshotMetadataTestJSON-1873244735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:02:00 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bbf19259-72aa-4a18-9e64-7eee4b39b084 tempest-SnapshotMetadataTestJSON-1873244735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:02:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bbf19259-72aa-4a18-9e64-7eee4b39b084 tempest-SnapshotMetadataTestJSON-1873244735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbf19259-72aa-4a18-9e64-7eee4b39b084 tempest-SnapshotMetadataTestJSON-1873244735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:00 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:02:00 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:01 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbf19259-72aa-4a18-9e64-7eee4b39b084 tempest-SnapshotMetadataTestJSON-1873244735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.269s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:01 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bbf19259-72aa-4a18-9e64-7eee4b39b084 tempest-SnapshotMetadataTestJSON-1873244735 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:02:01 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-bbf19259-72aa-4a18-9e64-7eee4b39b084 tempest-SnapshotMetadataTestJSON-1873244735 None] Deleted volume successfully. Sep 04 16:02:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbf19259-72aa-4a18-9e64-7eee4b39b084 tempest-SnapshotMetadataTestJSON-1873244735 None] Lock "cinder-10344da1-3ce1-45a7-b60a-bcefc9336ef0-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:05 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c110558b-bb9d-4a02-84f1-6349de46ba5e" returned: 0 in 4.488s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:05 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8270e19c-4930-4dc7-b0d7-8d52803d3071]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:05 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15 Sep 04 16:02:05 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:05 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15" returned: 0 in 0.516s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:05 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Image conversion details: src /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15, size 1024.00 MB, duration 4.49 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c110558b-bb9d-4a02-84f1-6349de46ba5e {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:02:05 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Converted 1024.00 MB image at 228.04 MB/s Sep 04 16:02:05 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c110558b-bb9d-4a02-84f1-6349de46ba5e is being set with open permissions: ugo+rw Sep 04 16:02:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c110558b-bb9d-4a02-84f1-6349de46ba5e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:05 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c110558b-bb9d-4a02-84f1-6349de46ba5e Sep 04 16:02:05 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:05 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c110558b-bb9d-4a02-84f1-6349de46ba5e" returned: 0 in 0.243s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Lock "cinder-quobyte-c110558b-bb9d-4a02-84f1-6349de46ba5e" released by "_copy_volume_from_snapshot" :: held 6.110s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Acquiring lock "cinder-quobyte-4679e986-f933-4105-baa3-b6a3fd7f0f54" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Lock "cinder-quobyte-4679e986-f933-4105-baa3-b6a3fd7f0f54" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Deleting offline snapshot 4679e986-f933-4105-baa3-b6a3fd7f0f54 of volume 9c20e63e-6249-476d-8251-401e84d5ae15 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:02:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] snapshot_file for this snap is: volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:02:05 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec695f6-8364-47f7-ba8d-5e62ad11a8ad]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:06 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54 Sep 04 16:02:06 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:06 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54" returned: 0 in 0.370s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:06 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c20e63e-6249-476d-8251-401e84d5ae15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:02:06 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[583ed384-e855-47f3-86c9-302b764a73e8]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:06 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15 Sep 04 16:02:06 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:06 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15" returned: 0 in 0.354s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:06 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54 Sep 04 16:02:06 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:07 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54" returned: 0 in 0.331s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:07 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54 Sep 04 16:02:07 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:07 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15.4679e986-f933-4105-baa3-b6a3fd7f0f54" returned: 0 in 0.253s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Lock "cinder-quobyte-4679e986-f933-4105-baa3-b6a3fd7f0f54" released by "_delete_snapshot" :: held 1.405s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.704s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d24ff998-6fc1-4682-b620-cd0921357b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c110558b-bb9d-4a02-84f1-6349de46ba5e', 'volume_size': 2, 'source_volid': '9c20e63e-6249-476d-8251-401e84d5ae15', 'source_volstatus': 'available'}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3bba9b-f0e3-4aa7-82d8-b743145ca34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:07 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Volume volume-c110558b-bb9d-4a02-84f1-6349de46ba5e (c110558b-bb9d-4a02-84f1-6349de46ba5e): created successfully Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3bba9b-f0e3-4aa7-82d8-b743145ca34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Flow 'volume_create_manager' (0ec16b24-62d4-446f-b7b6-cbf55f6de2b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:07 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-8163c44f-1c37-4bb9-8456-ab5953b6c496 tempest-VolumesCloneTest-1694792786 None] Created volume successfully. Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Flow 'volume_create_manager' (3f3ecbc0-b53b-4cd3-baf0-1e4681e15cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31257bab-b064-4a5d-a015-716853e8dd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31257bab-b064-4a5d-a015-716853e8dd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1573900969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7caf89-0d60-4670-9884-51cc6eb9a747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f09a3ad3f0f4a2782201a1b4610e57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:08Z,use_quota=True,user_id='828111b5d8794432bb9071cfdc585772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4387b8-73c2-423d-bfc1-a3f1658014dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4387b8-73c2-423d-bfc1-a3f1658014dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461e6cfb-f347-45b0-8efd-eff80a64b884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461e6cfb-f347-45b0-8efd-eff80a64b884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f7caf89-0d60-4670-9884-51cc6eb9a747', 'volume_name': 'volume-7f7caf89-0d60-4670-9884-51cc6eb9a747', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710c0902-ab9a-4e27-912d-8eaf5f51597e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710c0902-ab9a-4e27-912d-8eaf5f51597e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f15a575-e4ef-4503-85a9-11eb76a02deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:07 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Volume 7f7caf89-0d60-4670-9884-51cc6eb9a747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f7caf89-0d60-4670-9884-51cc6eb9a747', 'volume_size': 1} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1573900969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7caf89-0d60-4670-9884-51cc6eb9a747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f09a3ad3f0f4a2782201a1b4610e57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:08Z,use_quota=True,user_id='828111b5d8794432bb9071cfdc585772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Creating volume 7f7caf89-0d60-4670-9884-51cc6eb9a747 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:02:07 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:02:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7f7caf89-0d60-4670-9884-51cc6eb9a747 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:07 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7f7caf89-0d60-4670-9884-51cc6eb9a747 1073741824 Sep 04 16:02:07 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:08 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7f7caf89-0d60-4670-9884-51cc6eb9a747 1073741824" returned: 0 in 0.401s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7f7caf89-0d60-4670-9884-51cc6eb9a747 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:08 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7f7caf89-0d60-4670-9884-51cc6eb9a747 Sep 04 16:02:08 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:08 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7f7caf89-0d60-4670-9884-51cc6eb9a747" returned: 0 in 0.240s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:02:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f15a575-e4ef-4503-85a9-11eb76a02deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f7caf89-0d60-4670-9884-51cc6eb9a747', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f12a10-7316-401c-8134-bbb2cb69534c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:08 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Volume volume-7f7caf89-0d60-4670-9884-51cc6eb9a747 (7f7caf89-0d60-4670-9884-51cc6eb9a747): created successfully Sep 04 16:02:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f12a10-7316-401c-8134-bbb2cb69534c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Flow 'volume_create_manager' (3f3ecbc0-b53b-4cd3-baf0-1e4681e15cd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:08 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-5231dac6-0df9-4c3f-b93d-fba622963c19 tempest-VolumesTransfersV355Test-794300049 None] Created volume successfully. Sep 04 16:02:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-05057267-e85d-4ecd-8419-fda73357bf41 tempest-VolumesCloneTest-1694792786 None] Acquiring lock "cinder-c110558b-bb9d-4a02-84f1-6349de46ba5e-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-05057267-e85d-4ecd-8419-fda73357bf41 tempest-VolumesCloneTest-1694792786 None] Lock "cinder-c110558b-bb9d-4a02-84f1-6349de46ba5e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-05057267-e85d-4ecd-8419-fda73357bf41 tempest-VolumesCloneTest-1694792786 None] Acquiring lock "cinder-quobyte-c110558b-bb9d-4a02-84f1-6349de46ba5e" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-05057267-e85d-4ecd-8419-fda73357bf41 tempest-VolumesCloneTest-1694792786 None] Lock "cinder-quobyte-c110558b-bb9d-4a02-84f1-6349de46ba5e" acquired by "delete_volume" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:08 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[db859cdd-3b3a-4c5a-a218-a7e610fdbdbf]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-05057267-e85d-4ecd-8419-fda73357bf41 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c110558b-bb9d-4a02-84f1-6349de46ba5e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:08 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c110558b-bb9d-4a02-84f1-6349de46ba5e Sep 04 16:02:08 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:08 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-05057267-e85d-4ecd-8419-fda73357bf41 tempest-VolumesCloneTest-1694792786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c110558b-bb9d-4a02-84f1-6349de46ba5e" returned: 0 in 0.371s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-05057267-e85d-4ecd-8419-fda73357bf41 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c110558b-bb9d-4a02-84f1-6349de46ba5e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:08 devstack sudo[101288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c110558b-bb9d-4a02-84f1-6349de46ba5e Sep 04 16:02:08 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:09 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-77888459-a256-4465-b90e-07624eb7087f tempest-VolumesTransfersV355Test-1459873178 None] Transfer volume completed successfully. Sep 04 16:02:09 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-05057267-e85d-4ecd-8419-fda73357bf41 tempest-VolumesCloneTest-1694792786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c110558b-bb9d-4a02-84f1-6349de46ba5e" returned: 0 in 0.245s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-05057267-e85d-4ecd-8419-fda73357bf41 tempest-VolumesCloneTest-1694792786 None] Lock "cinder-quobyte-c110558b-bb9d-4a02-84f1-6349de46ba5e" released by "delete_volume" :: held 0.659s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-05057267-e85d-4ecd-8419-fda73357bf41 tempest-VolumesCloneTest-1694792786 None] Created reservations ['74b26b04-2f3d-4ce6-aa65-9a26fec13d1a', '4f747ab0-39ae-4d75-98fa-b4ec7dd79e12', '618157fe-72c7-471a-a636-706bd52f9f83', '39837038-7256-4548-8edc-37e1ca888d90'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-05057267-e85d-4ecd-8419-fda73357bf41 tempest-VolumesCloneTest-1694792786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-05057267-e85d-4ecd-8419-fda73357bf41 tempest-VolumesCloneTest-1694792786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-05057267-e85d-4ecd-8419-fda73357bf41 tempest-VolumesCloneTest-1694792786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-05057267-e85d-4ecd-8419-fda73357bf41 tempest-VolumesCloneTest-1694792786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-05057267-e85d-4ecd-8419-fda73357bf41 tempest-VolumesCloneTest-1694792786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-05057267-e85d-4ecd-8419-fda73357bf41 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:09 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:02:09 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:09 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-05057267-e85d-4ecd-8419-fda73357bf41 tempest-VolumesCloneTest-1694792786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.253s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-05057267-e85d-4ecd-8419-fda73357bf41 tempest-VolumesCloneTest-1694792786 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:02:09 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-05057267-e85d-4ecd-8419-fda73357bf41 tempest-VolumesCloneTest-1694792786 None] Deleted volume successfully. Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8efc270f-3efb-48d6-a623-ee4057d719a3 tempest-VolumesTransfersV355Test-31027405 None] Acquiring lock "cinder-7f7caf89-0d60-4670-9884-51cc6eb9a747-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8efc270f-3efb-48d6-a623-ee4057d719a3 tempest-VolumesTransfersV355Test-31027405 None] Lock "cinder-7f7caf89-0d60-4670-9884-51cc6eb9a747-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-05057267-e85d-4ecd-8419-fda73357bf41 tempest-VolumesCloneTest-1694792786 None] Lock "cinder-c110558b-bb9d-4a02-84f1-6349de46ba5e-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8efc270f-3efb-48d6-a623-ee4057d719a3 tempest-VolumesTransfersV355Test-31027405 None] Acquiring lock "cinder-quobyte-7f7caf89-0d60-4670-9884-51cc6eb9a747" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8efc270f-3efb-48d6-a623-ee4057d719a3 tempest-VolumesTransfersV355Test-31027405 None] Lock "cinder-quobyte-7f7caf89-0d60-4670-9884-51cc6eb9a747" acquired by "delete_volume" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-27f9e8c0-3080-4170-b5d5-b8e898c8a626 tempest-VolumesCloneTest-1694792786 None] Acquiring lock "cinder-9c20e63e-6249-476d-8251-401e84d5ae15-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb06954-eac8-408c-a11a-87dd6bf34e8a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8efc270f-3efb-48d6-a623-ee4057d719a3 tempest-VolumesTransfersV355Test-31027405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7f7caf89-0d60-4670-9884-51cc6eb9a747 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-27f9e8c0-3080-4170-b5d5-b8e898c8a626 tempest-VolumesCloneTest-1694792786 None] Lock "cinder-9c20e63e-6249-476d-8251-401e84d5ae15-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-27f9e8c0-3080-4170-b5d5-b8e898c8a626 tempest-VolumesCloneTest-1694792786 None] Acquiring lock "cinder-quobyte-9c20e63e-6249-476d-8251-401e84d5ae15" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-27f9e8c0-3080-4170-b5d5-b8e898c8a626 tempest-VolumesCloneTest-1694792786 None] Lock "cinder-quobyte-9c20e63e-6249-476d-8251-401e84d5ae15" acquired by "delete_volume" :: waited 0.014s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[95895a71-f93e-4bc5-9083-bbee994aaa67]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-27f9e8c0-3080-4170-b5d5-b8e898c8a626 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:09 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7f7caf89-0d60-4670-9884-51cc6eb9a747 Sep 04 16:02:09 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:09 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15 Sep 04 16:02:09 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:10 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8efc270f-3efb-48d6-a623-ee4057d719a3 tempest-VolumesTransfersV355Test-31027405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7f7caf89-0d60-4670-9884-51cc6eb9a747" returned: 0 in 0.370s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8efc270f-3efb-48d6-a623-ee4057d719a3 tempest-VolumesTransfersV355Test-31027405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7f7caf89-0d60-4670-9884-51cc6eb9a747 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:10 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7f7caf89-0d60-4670-9884-51cc6eb9a747 Sep 04 16:02:10 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:10 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-27f9e8c0-3080-4170-b5d5-b8e898c8a626 tempest-VolumesCloneTest-1694792786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15" returned: 0 in 0.369s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-27f9e8c0-3080-4170-b5d5-b8e898c8a626 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:10 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15 Sep 04 16:02:10 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:10 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8efc270f-3efb-48d6-a623-ee4057d719a3 tempest-VolumesTransfersV355Test-31027405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7f7caf89-0d60-4670-9884-51cc6eb9a747" returned: 0 in 0.275s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8efc270f-3efb-48d6-a623-ee4057d719a3 tempest-VolumesTransfersV355Test-31027405 None] Lock "cinder-quobyte-7f7caf89-0d60-4670-9884-51cc6eb9a747" released by "delete_volume" :: held 0.695s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-8efc270f-3efb-48d6-a623-ee4057d719a3 tempest-VolumesTransfersV355Test-31027405 None] Created reservations ['e6a9bf19-643e-4055-b7b2-d7f5324e2c4d', '304ae6be-9175-438b-8edb-c1bec7f0740a', '1eac2a56-727c-4c1a-9b46-7bd2cf7c005d', '1bd341f0-f350-42b7-97af-05ff2692ca10'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:02:10 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-27f9e8c0-3080-4170-b5d5-b8e898c8a626 tempest-VolumesCloneTest-1694792786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c20e63e-6249-476d-8251-401e84d5ae15" returned: 0 in 0.253s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-27f9e8c0-3080-4170-b5d5-b8e898c8a626 tempest-VolumesCloneTest-1694792786 None] Lock "cinder-quobyte-9c20e63e-6249-476d-8251-401e84d5ae15" released by "delete_volume" :: held 0.679s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8efc270f-3efb-48d6-a623-ee4057d719a3 tempest-VolumesTransfersV355Test-31027405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8efc270f-3efb-48d6-a623-ee4057d719a3 tempest-VolumesTransfersV355Test-31027405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8efc270f-3efb-48d6-a623-ee4057d719a3 tempest-VolumesTransfersV355Test-31027405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8efc270f-3efb-48d6-a623-ee4057d719a3 tempest-VolumesTransfersV355Test-31027405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8efc270f-3efb-48d6-a623-ee4057d719a3 tempest-VolumesTransfersV355Test-31027405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8efc270f-3efb-48d6-a623-ee4057d719a3 tempest-VolumesTransfersV355Test-31027405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-27f9e8c0-3080-4170-b5d5-b8e898c8a626 tempest-VolumesCloneTest-1694792786 None] Created reservations ['78870583-54ec-457d-a622-abc222c51c2e', '9dd442ef-47d5-4d5f-a06d-7c0ce26773b0', 'b08d4530-3c9e-4bc9-8806-b79d754f4544', '0784fc02-169e-4785-a299-fc887a294957'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:02:10 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:02:10 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-27f9e8c0-3080-4170-b5d5-b8e898c8a626 tempest-VolumesCloneTest-1694792786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-27f9e8c0-3080-4170-b5d5-b8e898c8a626 tempest-VolumesCloneTest-1694792786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-27f9e8c0-3080-4170-b5d5-b8e898c8a626 tempest-VolumesCloneTest-1694792786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-27f9e8c0-3080-4170-b5d5-b8e898c8a626 tempest-VolumesCloneTest-1694792786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-27f9e8c0-3080-4170-b5d5-b8e898c8a626 tempest-VolumesCloneTest-1694792786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-27f9e8c0-3080-4170-b5d5-b8e898c8a626 tempest-VolumesCloneTest-1694792786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:10 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:02:10 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:10 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8efc270f-3efb-48d6-a623-ee4057d719a3 tempest-VolumesTransfersV355Test-31027405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.271s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-8efc270f-3efb-48d6-a623-ee4057d719a3 tempest-VolumesTransfersV355Test-31027405 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:02:10 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-8efc270f-3efb-48d6-a623-ee4057d719a3 tempest-VolumesTransfersV355Test-31027405 None] Deleted volume successfully. Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8efc270f-3efb-48d6-a623-ee4057d719a3 tempest-VolumesTransfersV355Test-31027405 None] Lock "cinder-7f7caf89-0d60-4670-9884-51cc6eb9a747-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:10 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-27f9e8c0-3080-4170-b5d5-b8e898c8a626 tempest-VolumesCloneTest-1694792786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.283s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-27f9e8c0-3080-4170-b5d5-b8e898c8a626 tempest-VolumesCloneTest-1694792786 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:02:10 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-27f9e8c0-3080-4170-b5d5-b8e898c8a626 tempest-VolumesCloneTest-1694792786 None] Deleted volume successfully. Sep 04 16:02:10 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-27f9e8c0-3080-4170-b5d5-b8e898c8a626 tempest-VolumesCloneTest-1694792786 None] Lock "cinder-9c20e63e-6249-476d-8251-401e84d5ae15-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Flow 'volume_create_manager' (c4e30b2a-5012-47f0-aab3-566d6ae000f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1106ab02-cc17-4a52-9734-8607f9103414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1106ab02-cc17-4a52-9734-8607f9103414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-160131003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085ce400-6628-4a3d-8ff9-20a05a5e0a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f09a3ad3f0f4a2782201a1b4610e57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:11Z,use_quota=True,user_id='828111b5d8794432bb9071cfdc585772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d072433-7f89-4b11-a31f-1be665dbdf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d072433-7f89-4b11-a31f-1be665dbdf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699afeb8-e8ea-43d9-adef-a6911f5a61b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699afeb8-e8ea-43d9-adef-a6911f5a61b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '085ce400-6628-4a3d-8ff9-20a05a5e0a46', 'volume_name': 'volume-085ce400-6628-4a3d-8ff9-20a05a5e0a46', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc08dbe-8bb1-4955-a054-0f6e0846bc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc08dbe-8bb1-4955-a054-0f6e0846bc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09283360-53fd-4941-8d3c-755c31766de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:11 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Volume 085ce400-6628-4a3d-8ff9-20a05a5e0a46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-085ce400-6628-4a3d-8ff9-20a05a5e0a46', 'volume_size': 1} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-160131003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085ce400-6628-4a3d-8ff9-20a05a5e0a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f09a3ad3f0f4a2782201a1b4610e57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:11Z,use_quota=True,user_id='828111b5d8794432bb9071cfdc585772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Creating volume 085ce400-6628-4a3d-8ff9-20a05a5e0a46 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:02:11 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-085ce400-6628-4a3d-8ff9-20a05a5e0a46 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:11 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-085ce400-6628-4a3d-8ff9-20a05a5e0a46 1073741824 Sep 04 16:02:11 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:11 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-085ce400-6628-4a3d-8ff9-20a05a5e0a46 1073741824" returned: 0 in 0.434s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-085ce400-6628-4a3d-8ff9-20a05a5e0a46 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:11 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-085ce400-6628-4a3d-8ff9-20a05a5e0a46 Sep 04 16:02:11 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:12 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-085ce400-6628-4a3d-8ff9-20a05a5e0a46" returned: 0 in 0.278s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:02:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09283360-53fd-4941-8d3c-755c31766de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-085ce400-6628-4a3d-8ff9-20a05a5e0a46', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971a3dfc-c06d-43e6-b194-47a72e6140e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:12 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Volume volume-085ce400-6628-4a3d-8ff9-20a05a5e0a46 (085ce400-6628-4a3d-8ff9-20a05a5e0a46): created successfully Sep 04 16:02:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971a3dfc-c06d-43e6-b194-47a72e6140e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Flow 'volume_create_manager' (c4e30b2a-5012-47f0-aab3-566d6ae000f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:12 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-eded4a67-a2cd-4d71-9e8e-8cba6915505d tempest-VolumesTransfersV355Test-794300049 None] Created volume successfully. Sep 04 16:02:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f6ac2e0b-ff33-428c-8f39-2e08f203a922 tempest-VolumesTransfersV355Test-31027405 None] Acquiring lock "cinder-085ce400-6628-4a3d-8ff9-20a05a5e0a46-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f6ac2e0b-ff33-428c-8f39-2e08f203a922 tempest-VolumesTransfersV355Test-31027405 None] Lock "cinder-085ce400-6628-4a3d-8ff9-20a05a5e0a46-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f6ac2e0b-ff33-428c-8f39-2e08f203a922 tempest-VolumesTransfersV355Test-31027405 None] Acquiring lock "cinder-quobyte-085ce400-6628-4a3d-8ff9-20a05a5e0a46" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f6ac2e0b-ff33-428c-8f39-2e08f203a922 tempest-VolumesTransfersV355Test-31027405 None] Lock "cinder-quobyte-085ce400-6628-4a3d-8ff9-20a05a5e0a46" acquired by "delete_volume" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:12 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[274bc28b-d461-4a35-b82f-7c80f4046d13]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f6ac2e0b-ff33-428c-8f39-2e08f203a922 tempest-VolumesTransfersV355Test-31027405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-085ce400-6628-4a3d-8ff9-20a05a5e0a46 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:12 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-085ce400-6628-4a3d-8ff9-20a05a5e0a46 Sep 04 16:02:12 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:13 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f6ac2e0b-ff33-428c-8f39-2e08f203a922 tempest-VolumesTransfersV355Test-31027405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-085ce400-6628-4a3d-8ff9-20a05a5e0a46" returned: 0 in 0.377s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f6ac2e0b-ff33-428c-8f39-2e08f203a922 tempest-VolumesTransfersV355Test-31027405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-085ce400-6628-4a3d-8ff9-20a05a5e0a46 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:13 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-085ce400-6628-4a3d-8ff9-20a05a5e0a46 Sep 04 16:02:13 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:13 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f6ac2e0b-ff33-428c-8f39-2e08f203a922 tempest-VolumesTransfersV355Test-31027405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-085ce400-6628-4a3d-8ff9-20a05a5e0a46" returned: 0 in 0.253s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f6ac2e0b-ff33-428c-8f39-2e08f203a922 tempest-VolumesTransfersV355Test-31027405 None] Lock "cinder-quobyte-085ce400-6628-4a3d-8ff9-20a05a5e0a46" released by "delete_volume" :: held 0.672s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:13 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-f6ac2e0b-ff33-428c-8f39-2e08f203a922 tempest-VolumesTransfersV355Test-31027405 None] Created reservations ['83d7ec42-8b9e-44da-8fe0-3091eda39b0f', '053a9eb9-5982-4254-a27b-529a09c0b496', '4ac1ee42-1518-40ba-9d0b-299880a84977', '0e8b9159-b83d-41d7-bd77-cfb704cba13a'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:02:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f6ac2e0b-ff33-428c-8f39-2e08f203a922 tempest-VolumesTransfersV355Test-31027405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f6ac2e0b-ff33-428c-8f39-2e08f203a922 tempest-VolumesTransfersV355Test-31027405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f6ac2e0b-ff33-428c-8f39-2e08f203a922 tempest-VolumesTransfersV355Test-31027405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:02:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f6ac2e0b-ff33-428c-8f39-2e08f203a922 tempest-VolumesTransfersV355Test-31027405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:02:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f6ac2e0b-ff33-428c-8f39-2e08f203a922 tempest-VolumesTransfersV355Test-31027405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f6ac2e0b-ff33-428c-8f39-2e08f203a922 tempest-VolumesTransfersV355Test-31027405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:13 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:02:13 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:13 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f6ac2e0b-ff33-428c-8f39-2e08f203a922 tempest-VolumesTransfersV355Test-31027405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.283s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:13 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-f6ac2e0b-ff33-428c-8f39-2e08f203a922 tempest-VolumesTransfersV355Test-31027405 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:02:13 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-f6ac2e0b-ff33-428c-8f39-2e08f203a922 tempest-VolumesTransfersV355Test-31027405 None] Deleted volume successfully. Sep 04 16:02:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f6ac2e0b-ff33-428c-8f39-2e08f203a922 tempest-VolumesTransfersV355Test-31027405 None] Lock "cinder-085ce400-6628-4a3d-8ff9-20a05a5e0a46-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Flow 'volume_create_manager' (342ffc09-bd62-4092-a8be-3bac92596b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ccdbe9a-2bdf-4d8e-8277-45244c16e444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ccdbe9a-2bdf-4d8e-8277-45244c16e444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-87458323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166892af-e92e-44e0-9b7c-8e45b65e27ce,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dbea7d6ebb5e42029170f9803a35a032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:20Z,use_quota=True,user_id='db41984ff2df49dd8ae9ea5a0e5c8caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242f9933-25e9-4ca2-993b-233889cda2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242f9933-25e9-4ca2-993b-233889cda2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb1d163-82c1-4d77-acb4-f9dee42eb158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb1d163-82c1-4d77-acb4-f9dee42eb158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '166892af-e92e-44e0-9b7c-8e45b65e27ce', 'volume_name': 'volume-166892af-e92e-44e0-9b7c-8e45b65e27ce', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2596aef5-26d3-4526-a515-7ff718a70d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2596aef5-26d3-4526-a515-7ff718a70d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ad53cb-53c0-4f12-99d9-4bb432c195bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:19 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Volume 166892af-e92e-44e0-9b7c-8e45b65e27ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-166892af-e92e-44e0-9b7c-8e45b65e27ce', 'volume_size': 1} Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-87458323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166892af-e92e-44e0-9b7c-8e45b65e27ce,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dbea7d6ebb5e42029170f9803a35a032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:20Z,use_quota=True,user_id='db41984ff2df49dd8ae9ea5a0e5c8caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Creating volume 166892af-e92e-44e0-9b7c-8e45b65e27ce {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:02:19 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:02:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-166892af-e92e-44e0-9b7c-8e45b65e27ce 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:19 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-166892af-e92e-44e0-9b7c-8e45b65e27ce 1073741824 Sep 04 16:02:19 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:20 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-166892af-e92e-44e0-9b7c-8e45b65e27ce 1073741824" returned: 0 in 0.603s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-166892af-e92e-44e0-9b7c-8e45b65e27ce {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:20 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-166892af-e92e-44e0-9b7c-8e45b65e27ce Sep 04 16:02:20 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:20 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-166892af-e92e-44e0-9b7c-8e45b65e27ce" returned: 0 in 0.268s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:20 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:02:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ad53cb-53c0-4f12-99d9-4bb432c195bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-166892af-e92e-44e0-9b7c-8e45b65e27ce', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a596ef2e-ba16-4d6d-8be9-d0a0232e10d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:20 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Volume volume-166892af-e92e-44e0-9b7c-8e45b65e27ce (166892af-e92e-44e0-9b7c-8e45b65e27ce): created successfully Sep 04 16:02:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a596ef2e-ba16-4d6d-8be9-d0a0232e10d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Flow 'volume_create_manager' (342ffc09-bd62-4092-a8be-3bac92596b95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:20 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-c7dcaa9a-4997-4a89-bdcd-b1a2205e2436 tempest-VolumesGetTest-1911326072 None] Created volume successfully. Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Flow 'volume_create_manager' (9c796657-3a67-42bc-9a5d-19bdcbbe67f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e3a7b3b-bf64-4c18-b498-9313f35d52a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e3a7b3b-bf64-4c18-b498-9313f35d52a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:02:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1173901320',display_name='tempest-VolumesGetTest-Volume-246587633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca85577-6a32-466d-b815-a7283ab2a0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbea7d6ebb5e42029170f9803a35a032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:22Z,use_quota=True,user_id='db41984ff2df49dd8ae9ea5a0e5c8caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74363b44-8786-44e3-a142-f385b66bc15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74363b44-8786-44e3-a142-f385b66bc15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0903d0ef-6321-4bfb-97f5-1fcbf1ef96e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0903d0ef-6321-4bfb-97f5-1fcbf1ef96e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bca85577-6a32-466d-b815-a7283ab2a0bb', 'volume_name': 'volume-bca85577-6a32-466d-b815-a7283ab2a0bb', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b989e1b3-0f1c-43a5-a918-f4fb1367fabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b989e1b3-0f1c-43a5-a918-f4fb1367fabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b20f122-3289-4264-aa9e-dd2772731aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:22 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Volume bca85577-6a32-466d-b815-a7283ab2a0bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bca85577-6a32-466d-b815-a7283ab2a0bb', 'volume_size': 1} Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:02:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1173901320',display_name='tempest-VolumesGetTest-Volume-246587633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca85577-6a32-466d-b815-a7283ab2a0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbea7d6ebb5e42029170f9803a35a032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:22Z,use_quota=True,user_id='db41984ff2df49dd8ae9ea5a0e5c8caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Creating volume bca85577-6a32-466d-b815-a7283ab2a0bb {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:02:22 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:02:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bca85577-6a32-466d-b815-a7283ab2a0bb 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:22 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bca85577-6a32-466d-b815-a7283ab2a0bb 1073741824 Sep 04 16:02:22 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:23 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bca85577-6a32-466d-b815-a7283ab2a0bb 1073741824" returned: 0 in 0.532s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bca85577-6a32-466d-b815-a7283ab2a0bb {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:23 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bca85577-6a32-466d-b815-a7283ab2a0bb Sep 04 16:02:23 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:23 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bca85577-6a32-466d-b815-a7283ab2a0bb" returned: 0 in 0.268s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:02:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b20f122-3289-4264-aa9e-dd2772731aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca85577-6a32-466d-b815-a7283ab2a0bb', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cddd52-1cb7-458b-a85a-969cab894137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:23 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Volume volume-bca85577-6a32-466d-b815-a7283ab2a0bb (bca85577-6a32-466d-b815-a7283ab2a0bb): created successfully Sep 04 16:02:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cddd52-1cb7-458b-a85a-969cab894137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Flow 'volume_create_manager' (9c796657-3a67-42bc-9a5d-19bdcbbe67f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:23 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-934870e0-7500-4bee-9532-101a18b19121 tempest-VolumesGetTest-1911326072 None] Created volume successfully. Sep 04 16:02:24 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2a7c230a-d099-40af-b18c-42e761f844eb tempest-VolumesGetTest-1911326072 None] Acquiring lock "cinder-bca85577-6a32-466d-b815-a7283ab2a0bb-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:24 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2a7c230a-d099-40af-b18c-42e761f844eb tempest-VolumesGetTest-1911326072 None] Lock "cinder-bca85577-6a32-466d-b815-a7283ab2a0bb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:24 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2a7c230a-d099-40af-b18c-42e761f844eb tempest-VolumesGetTest-1911326072 None] Acquiring lock "cinder-quobyte-bca85577-6a32-466d-b815-a7283ab2a0bb" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:24 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2a7c230a-d099-40af-b18c-42e761f844eb tempest-VolumesGetTest-1911326072 None] Lock "cinder-quobyte-bca85577-6a32-466d-b815-a7283ab2a0bb" acquired by "delete_volume" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:24 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ff6241-3f64-42ff-a65c-60620096fe8e]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2a7c230a-d099-40af-b18c-42e761f844eb tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bca85577-6a32-466d-b815-a7283ab2a0bb {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:24 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bca85577-6a32-466d-b815-a7283ab2a0bb Sep 04 16:02:24 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:25 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2a7c230a-d099-40af-b18c-42e761f844eb tempest-VolumesGetTest-1911326072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bca85577-6a32-466d-b815-a7283ab2a0bb" returned: 0 in 0.398s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2a7c230a-d099-40af-b18c-42e761f844eb tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bca85577-6a32-466d-b815-a7283ab2a0bb {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:25 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bca85577-6a32-466d-b815-a7283ab2a0bb Sep 04 16:02:25 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:25 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2a7c230a-d099-40af-b18c-42e761f844eb tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bca85577-6a32-466d-b815-a7283ab2a0bb" returned: 0 in 0.270s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2a7c230a-d099-40af-b18c-42e761f844eb tempest-VolumesGetTest-1911326072 None] Lock "cinder-quobyte-bca85577-6a32-466d-b815-a7283ab2a0bb" released by "delete_volume" :: held 0.716s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:25 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-2a7c230a-d099-40af-b18c-42e761f844eb tempest-VolumesGetTest-1911326072 None] Created reservations ['e4748982-7b39-468f-bd82-dec417e242c4', '661dad9f-1b27-467a-882a-58e888ce19f7', 'f94c6c66-28b6-49e6-bbc9-ee3f2921711b', 'e64c582e-8e81-4d88-95f1-700fbc66a10d'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:02:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2a7c230a-d099-40af-b18c-42e761f844eb tempest-VolumesGetTest-1911326072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2a7c230a-d099-40af-b18c-42e761f844eb tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2a7c230a-d099-40af-b18c-42e761f844eb tempest-VolumesGetTest-1911326072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:02:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2a7c230a-d099-40af-b18c-42e761f844eb tempest-VolumesGetTest-1911326072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:02:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2a7c230a-d099-40af-b18c-42e761f844eb tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2a7c230a-d099-40af-b18c-42e761f844eb tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:25 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:02:25 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:25 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2a7c230a-d099-40af-b18c-42e761f844eb tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.268s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:25 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-2a7c230a-d099-40af-b18c-42e761f844eb tempest-VolumesGetTest-1911326072 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:02:25 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-2a7c230a-d099-40af-b18c-42e761f844eb tempest-VolumesGetTest-1911326072 None] Deleted volume successfully. Sep 04 16:02:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2a7c230a-d099-40af-b18c-42e761f844eb tempest-VolumesGetTest-1911326072 None] Lock "cinder-bca85577-6a32-466d-b815-a7283ab2a0bb-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-54fa8056-94e5-4ff9-8e15-3bd49ba6e2ad tempest-VolumesGetTest-1911326072 None] Acquiring lock "cinder-166892af-e92e-44e0-9b7c-8e45b65e27ce-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-54fa8056-94e5-4ff9-8e15-3bd49ba6e2ad tempest-VolumesGetTest-1911326072 None] Lock "cinder-166892af-e92e-44e0-9b7c-8e45b65e27ce-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-54fa8056-94e5-4ff9-8e15-3bd49ba6e2ad tempest-VolumesGetTest-1911326072 None] Acquiring lock "cinder-quobyte-166892af-e92e-44e0-9b7c-8e45b65e27ce" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-54fa8056-94e5-4ff9-8e15-3bd49ba6e2ad tempest-VolumesGetTest-1911326072 None] Lock "cinder-quobyte-166892af-e92e-44e0-9b7c-8e45b65e27ce" acquired by "delete_volume" :: waited 0.026s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:26 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[73df5da1-144e-49e6-ac53-79c6862e97fa]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-54fa8056-94e5-4ff9-8e15-3bd49ba6e2ad tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-166892af-e92e-44e0-9b7c-8e45b65e27ce {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:26 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-166892af-e92e-44e0-9b7c-8e45b65e27ce Sep 04 16:02:26 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:26 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-54fa8056-94e5-4ff9-8e15-3bd49ba6e2ad tempest-VolumesGetTest-1911326072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-166892af-e92e-44e0-9b7c-8e45b65e27ce" returned: 0 in 0.383s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-54fa8056-94e5-4ff9-8e15-3bd49ba6e2ad tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-166892af-e92e-44e0-9b7c-8e45b65e27ce {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:26 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-166892af-e92e-44e0-9b7c-8e45b65e27ce Sep 04 16:02:26 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:26 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-54fa8056-94e5-4ff9-8e15-3bd49ba6e2ad tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-166892af-e92e-44e0-9b7c-8e45b65e27ce" returned: 0 in 0.258s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-54fa8056-94e5-4ff9-8e15-3bd49ba6e2ad tempest-VolumesGetTest-1911326072 None] Lock "cinder-quobyte-166892af-e92e-44e0-9b7c-8e45b65e27ce" released by "delete_volume" :: held 0.690s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:26 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-54fa8056-94e5-4ff9-8e15-3bd49ba6e2ad tempest-VolumesGetTest-1911326072 None] Created reservations ['d4c621e2-8cb4-4c98-a318-c236aee6048f', '5a65ecbd-0886-41b3-9042-6f70f0873f16', 'c4705140-caae-4763-aa1e-6046882584f3', '36fa1853-2d31-44f5-a4a9-91c7d4c383c1'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:02:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-54fa8056-94e5-4ff9-8e15-3bd49ba6e2ad tempest-VolumesGetTest-1911326072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-54fa8056-94e5-4ff9-8e15-3bd49ba6e2ad tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-54fa8056-94e5-4ff9-8e15-3bd49ba6e2ad tempest-VolumesGetTest-1911326072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:02:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-54fa8056-94e5-4ff9-8e15-3bd49ba6e2ad tempest-VolumesGetTest-1911326072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:02:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-54fa8056-94e5-4ff9-8e15-3bd49ba6e2ad tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-54fa8056-94e5-4ff9-8e15-3bd49ba6e2ad tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:26 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:02:26 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:27 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-54fa8056-94e5-4ff9-8e15-3bd49ba6e2ad tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.272s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-54fa8056-94e5-4ff9-8e15-3bd49ba6e2ad tempest-VolumesGetTest-1911326072 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:02:27 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-54fa8056-94e5-4ff9-8e15-3bd49ba6e2ad tempest-VolumesGetTest-1911326072 None] Deleted volume successfully. Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-54fa8056-94e5-4ff9-8e15-3bd49ba6e2ad tempest-VolumesGetTest-1911326072 None] Lock "cinder-166892af-e92e-44e0-9b7c-8e45b65e27ce-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Flow 'volume_create_manager' (75e6d84b-7d0c-42d0-9ef0-1f5d284ee450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171cf55f-54b7-4b49-bda0-62b7aeff8ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171cf55f-54b7-4b49-bda0-62b7aeff8ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1723715226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e96de6-ea3e-4745-a08a-7d965f02686d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbea7d6ebb5e42029170f9803a35a032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:28Z,use_quota=True,user_id='db41984ff2df49dd8ae9ea5a0e5c8caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27fa8a3b-592f-4ae9-ad82-d6be38c8ae79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27fa8a3b-592f-4ae9-ad82-d6be38c8ae79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ca45fa-c9ae-406e-834f-29878756b26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ca45fa-c9ae-406e-834f-29878756b26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6e96de6-ea3e-4745-a08a-7d965f02686d', 'volume_name': 'volume-e6e96de6-ea3e-4745-a08a-7d965f02686d', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f14f0d1-86c3-47d4-86ad-066d0b893d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f14f0d1-86c3-47d4-86ad-066d0b893d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4c4ab0-35ad-4b6a-becf-7db76fbbdcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:27 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Volume e6e96de6-ea3e-4745-a08a-7d965f02686d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6e96de6-ea3e-4745-a08a-7d965f02686d', 'volume_size': 1} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1723715226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e96de6-ea3e-4745-a08a-7d965f02686d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbea7d6ebb5e42029170f9803a35a032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:28Z,use_quota=True,user_id='db41984ff2df49dd8ae9ea5a0e5c8caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Creating volume e6e96de6-ea3e-4745-a08a-7d965f02686d {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:02:27 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:02:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:27 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d 1073741824 Sep 04 16:02:27 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:28 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d 1073741824" returned: 0 in 0.527s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:28 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d Sep 04 16:02:28 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:28 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d" returned: 0 in 0.286s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:02:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4c4ab0-35ad-4b6a-becf-7db76fbbdcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e96de6-ea3e-4745-a08a-7d965f02686d', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c59933a-7096-4167-ad0b-5a3c99fb0c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:28 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Volume volume-e6e96de6-ea3e-4745-a08a-7d965f02686d (e6e96de6-ea3e-4745-a08a-7d965f02686d): created successfully Sep 04 16:02:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c59933a-7096-4167-ad0b-5a3c99fb0c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Flow 'volume_create_manager' (75e6d84b-7d0c-42d0-9ef0-1f5d284ee450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:28 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-7e17b307-1af9-4ed3-be38-60add30003e9 tempest-VolumesGetTest-1911326072 None] Created volume successfully. Sep 04 16:02:30 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=105,cinder:SELECT=82,cinder:DELETE=11,cinder:INSERT=30 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:02:30 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=88,cinder:INSERT=22,cinder:UPDATE=122,cinder:DELETE=8 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:02:30 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:02:30 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Flow 'volume_create_manager' (cff557e3-8ab6-4935-9c2f-835c18fcdae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:30 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a1ca28-99aa-4c04-af7f-eff3b153b7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:30 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a1ca28-99aa-4c04-af7f-eff3b153b7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1154843066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6586a571-a4b3-4428-ad86-3a29c43477ab,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dbea7d6ebb5e42029170f9803a35a032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e6e96de6-ea3e-4745-a08a-7d965f02686d,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:30Z,use_quota=True,user_id='db41984ff2df49dd8ae9ea5a0e5c8caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:30 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0cebb0-9591-483e-9da3-ebc0fe5c6507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:30 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0cebb0-9591-483e-9da3-ebc0fe5c6507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:30 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (881717b0-7394-4dc4-b506-c68e1a508b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:30 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (881717b0-7394-4dc4-b506-c68e1a508b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6586a571-a4b3-4428-ad86-3a29c43477ab', 'volume_name': 'volume-6586a571-a4b3-4428-ad86-3a29c43477ab', 'volume_size': 1, 'source_volid': 'e6e96de6-ea3e-4745-a08a-7d965f02686d', 'source_volstatus': 'available'}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:30 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159dc393-87cf-4478-928f-7f9767399578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:30 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159dc393-87cf-4478-928f-7f9767399578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:30 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4516c58-b5bc-4052-b69e-1bdd36d656de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:30 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Volume 6586a571-a4b3-4428-ad86-3a29c43477ab: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6586a571-a4b3-4428-ad86-3a29c43477ab', 'volume_size': 1, 'source_volid': 'e6e96de6-ea3e-4745-a08a-7d965f02686d', 'source_volstatus': 'available'} Sep 04 16:02:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:30 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Cloning volume e6e96de6-ea3e-4745-a08a-7d965f02686d to volume 6586a571-a4b3-4428-ad86-3a29c43477ab Sep 04 16:02:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Creating offline snapshot d569d8b4-4c75-46f4-adfe-f1a596169995 of volume e6e96de6-ea3e-4745-a08a-7d965f02686d {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:02:30 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd623a0-cdf9-4857-a9f9-83c227764084]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:30 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d Sep 04 16:02:30 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:31 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d" returned: 0 in 0.402s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:31 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995 1G Sep 04 16:02:31 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:31 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995 1G" returned: 0 in 0.460s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6e96de6-ea3e-4745-a08a-7d965f02686d -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:31 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6e96de6-ea3e-4745-a08a-7d965f02686d -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995 Sep 04 16:02:31 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:31 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6e96de6-ea3e-4745-a08a-7d965f02686d -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995" returned: 0 in 0.313s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:31 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995 is being set with open permissions: ugo+rw Sep 04 16:02:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:31 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995 Sep 04 16:02:31 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:32 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995" returned: 0 in 0.259s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:32 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.info Sep 04 16:02:32 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:32 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.info" returned: 0 in 0.287s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:32 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.info is being set with open permissions: ugo+rw Sep 04 16:02:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:32 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.info Sep 04 16:02:32 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:32 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.info" returned: 0 in 0.312s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Acquiring lock "cinder-quobyte-6586a571-a4b3-4428-ad86-3a29c43477ab" by "_copy_volume_from_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Lock "cinder-quobyte-6586a571-a4b3-4428-ad86-3a29c43477ab" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] snapshot: d569d8b4-4c75-46f4-adfe-f1a596169995, volume: 6586a571-a4b3-4428-ad86-3a29c43477ab, {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 04 16:02:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:02:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:02:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:32 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[007cee7d-818b-4bf7-8306-fc0ea95a74af]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:32 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995 Sep 04 16:02:32 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:33 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995" returned: 0 in 0.437s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6e96de6-ea3e-4745-a08a-7d965f02686d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:02:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] will copy from snapshot at /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 04 16:02:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Creating direct copy from snapshot {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 04 16:02:33 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0f8e18-792b-4c97-a497-a1ecc2214c6a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:33 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d Sep 04 16:02:33 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:33 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d" returned: 0 in 0.388s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:33 devstack cinder-volume[87513]: DEBUG cinder.utils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Path /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6586a571-a4b3-4428-ad86-3a29c43477ab not found in is_blk_device check {{(pid=87513) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 04 16:02:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6586a571-a4b3-4428-ad86-3a29c43477ab {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:33 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6586a571-a4b3-4428-ad86-3a29c43477ab Sep 04 16:02:33 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:02:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:02:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:02:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:34 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:02:34 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:35 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.533s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:02:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:02:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 28 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:02:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 16:02:38 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6586a571-a4b3-4428-ad86-3a29c43477ab" returned: 0 in 4.756s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:38 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd90a8c2-4217-4da2-9954-e932cfbdef0d]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:38 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d Sep 04 16:02:38 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:38 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d" returned: 0 in 0.539s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:38 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Image conversion details: src /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d, size 1024.00 MB, duration 4.76 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6586a571-a4b3-4428-ad86-3a29c43477ab {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:02:38 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Converted 1024.00 MB image at 215.19 MB/s Sep 04 16:02:38 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6586a571-a4b3-4428-ad86-3a29c43477ab is being set with open permissions: ugo+rw Sep 04 16:02:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6586a571-a4b3-4428-ad86-3a29c43477ab {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:38 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6586a571-a4b3-4428-ad86-3a29c43477ab Sep 04 16:02:38 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:39 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6586a571-a4b3-4428-ad86-3a29c43477ab" returned: 0 in 0.270s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Lock "cinder-quobyte-6586a571-a4b3-4428-ad86-3a29c43477ab" released by "_copy_volume_from_snapshot" :: held 6.476s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Acquiring lock "cinder-quobyte-d569d8b4-4c75-46f4-adfe-f1a596169995" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Lock "cinder-quobyte-d569d8b4-4c75-46f4-adfe-f1a596169995" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Deleting offline snapshot d569d8b4-4c75-46f4-adfe-f1a596169995 of volume e6e96de6-ea3e-4745-a08a-7d965f02686d {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:02:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] snapshot_file for this snap is: volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:02:39 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6340bd-e04e-4edc-977d-ac4f918dde6c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:39 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995 Sep 04 16:02:39 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:39 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995" returned: 0 in 0.376s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6e96de6-ea3e-4745-a08a-7d965f02686d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:02:39 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aa163f-a12f-4219-bc27-c9cf2a3256d0]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:39 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d Sep 04 16:02:39 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:40 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d" returned: 0 in 0.387s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:40 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995 Sep 04 16:02:40 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:40 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995" returned: 0 in 0.407s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:40 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995 Sep 04 16:02:40 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:40 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d.d569d8b4-4c75-46f4-adfe-f1a596169995" returned: 0 in 0.300s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Lock "cinder-quobyte-d569d8b4-4c75-46f4-adfe-f1a596169995" released by "_delete_snapshot" :: held 1.581s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.307s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4516c58-b5bc-4052-b69e-1bdd36d656de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6586a571-a4b3-4428-ad86-3a29c43477ab', 'volume_size': 1, 'source_volid': 'e6e96de6-ea3e-4745-a08a-7d965f02686d', 'source_volstatus': 'available'}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b83b86-dc08-431b-8d5e-b4fba646d525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:40 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Volume volume-6586a571-a4b3-4428-ad86-3a29c43477ab (6586a571-a4b3-4428-ad86-3a29c43477ab): created successfully Sep 04 16:02:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b83b86-dc08-431b-8d5e-b4fba646d525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Flow 'volume_create_manager' (cff557e3-8ab6-4935-9c2f-835c18fcdae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:40 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-f76dda0e-58e9-47b7-8484-e7a700f98722 tempest-VolumesGetTest-1911326072 None] Created volume successfully. Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Flow 'volume_create_manager' (9a71992f-c82e-4454-b2c4-9f1430be024f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3822a46f-5e3e-4424-bae6-3aeabfa42370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3822a46f-5e3e-4424-bae6-3aeabfa42370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:02:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1371625040',display_name='tempest-VolumesGetTest-Volume-57595316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fc6a17-81bd-4531-8454-4934593d564c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbea7d6ebb5e42029170f9803a35a032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:42Z,use_quota=True,user_id='db41984ff2df49dd8ae9ea5a0e5c8caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e083aca8-283b-4cd2-91f3-ff8e44edf647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e083aca8-283b-4cd2-91f3-ff8e44edf647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (385d1101-bc1a-461b-950a-29af05086fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (385d1101-bc1a-461b-950a-29af05086fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09fc6a17-81bd-4531-8454-4934593d564c', 'volume_name': 'volume-09fc6a17-81bd-4531-8454-4934593d564c', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d868a90c-b518-4edf-9a7f-49dd86f19468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d868a90c-b518-4edf-9a7f-49dd86f19468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a7dac2e-9556-4676-b184-fdd52bdfa2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:42 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Volume 09fc6a17-81bd-4531-8454-4934593d564c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09fc6a17-81bd-4531-8454-4934593d564c', 'volume_size': 1} Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:02:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1371625040',display_name='tempest-VolumesGetTest-Volume-57595316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fc6a17-81bd-4531-8454-4934593d564c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbea7d6ebb5e42029170f9803a35a032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:42Z,use_quota=True,user_id='db41984ff2df49dd8ae9ea5a0e5c8caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Creating volume 09fc6a17-81bd-4531-8454-4934593d564c {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:02:42 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09fc6a17-81bd-4531-8454-4934593d564c 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:42 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09fc6a17-81bd-4531-8454-4934593d564c 1073741824 Sep 04 16:02:42 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:42 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09fc6a17-81bd-4531-8454-4934593d564c 1073741824" returned: 0 in 0.501s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09fc6a17-81bd-4531-8454-4934593d564c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:42 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09fc6a17-81bd-4531-8454-4934593d564c Sep 04 16:02:42 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:43 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09fc6a17-81bd-4531-8454-4934593d564c" returned: 0 in 0.285s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:02:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:43 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a7dac2e-9556-4676-b184-fdd52bdfa2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09fc6a17-81bd-4531-8454-4934593d564c', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:43 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0af4933-a973-45b2-9d93-342c0c2db70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:43 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Volume volume-09fc6a17-81bd-4531-8454-4934593d564c (09fc6a17-81bd-4531-8454-4934593d564c): created successfully Sep 04 16:02:43 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0af4933-a973-45b2-9d93-342c0c2db70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:43 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Flow 'volume_create_manager' (9a71992f-c82e-4454-b2c4-9f1430be024f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:43 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-be7e9254-92ee-4637-a8dc-eddb3466e058 tempest-VolumesGetTest-1911326072 None] Created volume successfully. Sep 04 16:02:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-28859869-ddaf-4de4-9fbc-4303872b45e1 tempest-VolumesGetTest-1911326072 None] Acquiring lock "cinder-09fc6a17-81bd-4531-8454-4934593d564c-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-28859869-ddaf-4de4-9fbc-4303872b45e1 tempest-VolumesGetTest-1911326072 None] Lock "cinder-09fc6a17-81bd-4531-8454-4934593d564c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-28859869-ddaf-4de4-9fbc-4303872b45e1 tempest-VolumesGetTest-1911326072 None] Acquiring lock "cinder-quobyte-09fc6a17-81bd-4531-8454-4934593d564c" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-28859869-ddaf-4de4-9fbc-4303872b45e1 tempest-VolumesGetTest-1911326072 None] Lock "cinder-quobyte-09fc6a17-81bd-4531-8454-4934593d564c" acquired by "delete_volume" :: waited 0.025s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:44 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3cc1d8-e225-4332-a4f3-5d78dfd3f5db]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-28859869-ddaf-4de4-9fbc-4303872b45e1 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09fc6a17-81bd-4531-8454-4934593d564c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:44 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09fc6a17-81bd-4531-8454-4934593d564c Sep 04 16:02:44 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:45 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-28859869-ddaf-4de4-9fbc-4303872b45e1 tempest-VolumesGetTest-1911326072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09fc6a17-81bd-4531-8454-4934593d564c" returned: 0 in 0.500s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-28859869-ddaf-4de4-9fbc-4303872b45e1 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09fc6a17-81bd-4531-8454-4934593d564c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:45 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09fc6a17-81bd-4531-8454-4934593d564c Sep 04 16:02:45 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:45 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-28859869-ddaf-4de4-9fbc-4303872b45e1 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-09fc6a17-81bd-4531-8454-4934593d564c" returned: 0 in 0.254s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-28859869-ddaf-4de4-9fbc-4303872b45e1 tempest-VolumesGetTest-1911326072 None] Lock "cinder-quobyte-09fc6a17-81bd-4531-8454-4934593d564c" released by "delete_volume" :: held 0.821s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:45 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-28859869-ddaf-4de4-9fbc-4303872b45e1 tempest-VolumesGetTest-1911326072 None] Created reservations ['9990e910-c2cd-4dea-b7f2-b0406e255dac', 'b3a1f75f-9d38-4f74-a8d2-8acb2227cd75', '2c48d36e-e728-4c00-b502-63cb2d0bad85', '96d8a084-92f8-4344-bbcf-8d0bfea17ec0'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:02:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-28859869-ddaf-4de4-9fbc-4303872b45e1 tempest-VolumesGetTest-1911326072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-28859869-ddaf-4de4-9fbc-4303872b45e1 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-28859869-ddaf-4de4-9fbc-4303872b45e1 tempest-VolumesGetTest-1911326072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:02:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-28859869-ddaf-4de4-9fbc-4303872b45e1 tempest-VolumesGetTest-1911326072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:02:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-28859869-ddaf-4de4-9fbc-4303872b45e1 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-28859869-ddaf-4de4-9fbc-4303872b45e1 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:45 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:02:45 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4314bbf1-9157-47b9-8613-e6eabf50b981 tempest-VolumesGetTest-1911326072 None] Acquiring lock "cinder-6586a571-a4b3-4428-ad86-3a29c43477ab-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4314bbf1-9157-47b9-8613-e6eabf50b981 tempest-VolumesGetTest-1911326072 None] Lock "cinder-6586a571-a4b3-4428-ad86-3a29c43477ab-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:46 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-28859869-ddaf-4de4-9fbc-4303872b45e1 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.378s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:46 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-28859869-ddaf-4de4-9fbc-4303872b45e1 tempest-VolumesGetTest-1911326072 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:02:46 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-28859869-ddaf-4de4-9fbc-4303872b45e1 tempest-VolumesGetTest-1911326072 None] Deleted volume successfully. Sep 04 16:02:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4314bbf1-9157-47b9-8613-e6eabf50b981 tempest-VolumesGetTest-1911326072 None] Acquiring lock "cinder-quobyte-6586a571-a4b3-4428-ad86-3a29c43477ab" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4314bbf1-9157-47b9-8613-e6eabf50b981 tempest-VolumesGetTest-1911326072 None] Lock "cinder-quobyte-6586a571-a4b3-4428-ad86-3a29c43477ab" acquired by "delete_volume" :: waited 0.034s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-28859869-ddaf-4de4-9fbc-4303872b45e1 tempest-VolumesGetTest-1911326072 None] Lock "cinder-09fc6a17-81bd-4531-8454-4934593d564c-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:46 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[90753de1-e304-4eb5-a878-758f6279de5d]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4314bbf1-9157-47b9-8613-e6eabf50b981 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6586a571-a4b3-4428-ad86-3a29c43477ab {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:46 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6586a571-a4b3-4428-ad86-3a29c43477ab Sep 04 16:02:46 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:46 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4314bbf1-9157-47b9-8613-e6eabf50b981 tempest-VolumesGetTest-1911326072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6586a571-a4b3-4428-ad86-3a29c43477ab" returned: 0 in 0.406s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4314bbf1-9157-47b9-8613-e6eabf50b981 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6586a571-a4b3-4428-ad86-3a29c43477ab {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:46 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6586a571-a4b3-4428-ad86-3a29c43477ab Sep 04 16:02:46 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4314bbf1-9157-47b9-8613-e6eabf50b981 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6586a571-a4b3-4428-ad86-3a29c43477ab" returned: 0 in 0.322s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:46 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4314bbf1-9157-47b9-8613-e6eabf50b981 tempest-VolumesGetTest-1911326072 None] Lock "cinder-quobyte-6586a571-a4b3-4428-ad86-3a29c43477ab" released by "delete_volume" :: held 0.792s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:46 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-4314bbf1-9157-47b9-8613-e6eabf50b981 tempest-VolumesGetTest-1911326072 None] Created reservations ['a5b8d1d6-3a71-4f50-b724-84bb4639eb39', '12d8caa0-b103-428d-8279-7e521a5b5a4e', '6f87ff5a-44d5-44e4-b566-d949240e6fc2', '25e0b695-1279-49e6-af48-b8d287c57deb'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4314bbf1-9157-47b9-8613-e6eabf50b981 tempest-VolumesGetTest-1911326072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4314bbf1-9157-47b9-8613-e6eabf50b981 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4314bbf1-9157-47b9-8613-e6eabf50b981 tempest-VolumesGetTest-1911326072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4314bbf1-9157-47b9-8613-e6eabf50b981 tempest-VolumesGetTest-1911326072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4314bbf1-9157-47b9-8613-e6eabf50b981 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4314bbf1-9157-47b9-8613-e6eabf50b981 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:47 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:02:47 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3d81fc9b-510f-453c-852f-d3f6240df900 tempest-VolumesGetTest-1911326072 None] Acquiring lock "cinder-e6e96de6-ea3e-4745-a08a-7d965f02686d-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3d81fc9b-510f-453c-852f-d3f6240df900 tempest-VolumesGetTest-1911326072 None] Lock "cinder-e6e96de6-ea3e-4745-a08a-7d965f02686d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:47 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4314bbf1-9157-47b9-8613-e6eabf50b981 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.381s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3d81fc9b-510f-453c-852f-d3f6240df900 tempest-VolumesGetTest-1911326072 None] Acquiring lock "cinder-quobyte-e6e96de6-ea3e-4745-a08a-7d965f02686d" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-4314bbf1-9157-47b9-8613-e6eabf50b981 tempest-VolumesGetTest-1911326072 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:02:47 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-4314bbf1-9157-47b9-8613-e6eabf50b981 tempest-VolumesGetTest-1911326072 None] Deleted volume successfully. Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3d81fc9b-510f-453c-852f-d3f6240df900 tempest-VolumesGetTest-1911326072 None] Lock "cinder-quobyte-e6e96de6-ea3e-4745-a08a-7d965f02686d" acquired by "delete_volume" :: waited 0.043s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4314bbf1-9157-47b9-8613-e6eabf50b981 tempest-VolumesGetTest-1911326072 None] Lock "cinder-6586a571-a4b3-4428-ad86-3a29c43477ab-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0646fa55-41f4-4884-938d-826abc209210]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3d81fc9b-510f-453c-852f-d3f6240df900 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Flow 'volume_create_manager' (98a69a5f-6362-46bf-b3e9-5da453d8492f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d12425e2-2e9d-42c9-8553-cf4462f8c031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:47 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d Sep 04 16:02:47 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d12425e2-2e9d-42c9-8553-cf4462f8c031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-422969511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d089f584-df99-4b27-b100-c3ebd8d92c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6e70869cf14fd4a7c8e8f220fe5f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:48Z,use_quota=True,user_id='b1a0d0b62a194b748b160d48a301d06a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c8abe20-adc4-4c71-8991-9984b4d1d4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c8abe20-adc4-4c71-8991-9984b4d1d4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4845b2d1-4c34-4fdb-a825-14564fe5c022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4845b2d1-4c34-4fdb-a825-14564fe5c022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd089f584-df99-4b27-b100-c3ebd8d92c70', 'volume_name': 'volume-d089f584-df99-4b27-b100-c3ebd8d92c70', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c50b232-5413-48a4-984a-199bbd98b3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c50b232-5413-48a4-984a-199bbd98b3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c01c8a-6981-4c4e-ae74-a3bd701078d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:47 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Volume d089f584-df99-4b27-b100-c3ebd8d92c70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d089f584-df99-4b27-b100-c3ebd8d92c70', 'volume_size': 1} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-422969511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d089f584-df99-4b27-b100-c3ebd8d92c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6e70869cf14fd4a7c8e8f220fe5f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:48Z,use_quota=True,user_id='b1a0d0b62a194b748b160d48a301d06a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Creating volume d089f584-df99-4b27-b100-c3ebd8d92c70 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:02:47 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:02:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d089f584-df99-4b27-b100-c3ebd8d92c70 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:47 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d089f584-df99-4b27-b100-c3ebd8d92c70 1073741824 Sep 04 16:02:47 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:48 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3d81fc9b-510f-453c-852f-d3f6240df900 tempest-VolumesGetTest-1911326072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d" returned: 0 in 0.412s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3d81fc9b-510f-453c-852f-d3f6240df900 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:48 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d Sep 04 16:02:48 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:48 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d089f584-df99-4b27-b100-c3ebd8d92c70 1073741824" returned: 0 in 0.463s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d089f584-df99-4b27-b100-c3ebd8d92c70 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:48 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3d81fc9b-510f-453c-852f-d3f6240df900 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-e6e96de6-ea3e-4745-a08a-7d965f02686d" returned: 0 in 0.299s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:48 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d089f584-df99-4b27-b100-c3ebd8d92c70 Sep 04 16:02:48 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3d81fc9b-510f-453c-852f-d3f6240df900 tempest-VolumesGetTest-1911326072 None] Lock "cinder-quobyte-e6e96de6-ea3e-4745-a08a-7d965f02686d" released by "delete_volume" :: held 0.798s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-3d81fc9b-510f-453c-852f-d3f6240df900 tempest-VolumesGetTest-1911326072 None] Created reservations ['94c12bea-9718-4d5b-9f94-c685ed42b692', '68a52172-8caf-4548-be3b-2f7fdbfc832f', 'e5ad4f2d-a61e-4215-a6b8-b713b2d6f1ee', '05f585fb-d82d-418a-b83a-0db44b345c2c'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3d81fc9b-510f-453c-852f-d3f6240df900 tempest-VolumesGetTest-1911326072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3d81fc9b-510f-453c-852f-d3f6240df900 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3d81fc9b-510f-453c-852f-d3f6240df900 tempest-VolumesGetTest-1911326072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3d81fc9b-510f-453c-852f-d3f6240df900 tempest-VolumesGetTest-1911326072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3d81fc9b-510f-453c-852f-d3f6240df900 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3d81fc9b-510f-453c-852f-d3f6240df900 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:48 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:02:48 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:48 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d089f584-df99-4b27-b100-c3ebd8d92c70" returned: 0 in 0.282s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c01c8a-6981-4c4e-ae74-a3bd701078d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d089f584-df99-4b27-b100-c3ebd8d92c70', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b05f75-fbd9-4145-b201-de13cc01f335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:48 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Volume volume-d089f584-df99-4b27-b100-c3ebd8d92c70 (d089f584-df99-4b27-b100-c3ebd8d92c70): created successfully Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b05f75-fbd9-4145-b201-de13cc01f335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Flow 'volume_create_manager' (98a69a5f-6362-46bf-b3e9-5da453d8492f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:48 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-6a463863-a2e9-4116-90a8-5bd5b0b66ae8 tempest-TestMinimumBasicScenario-354275421 None] Created volume successfully. Sep 04 16:02:48 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3d81fc9b-510f-453c-852f-d3f6240df900 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.305s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-3d81fc9b-510f-453c-852f-d3f6240df900 tempest-VolumesGetTest-1911326072 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:02:48 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-3d81fc9b-510f-453c-852f-d3f6240df900 tempest-VolumesGetTest-1911326072 None] Deleted volume successfully. Sep 04 16:02:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3d81fc9b-510f-453c-852f-d3f6240df900 tempest-VolumesGetTest-1911326072 None] Lock "cinder-e6e96de6-ea3e-4745-a08a-7d965f02686d-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:49 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:02:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Flow 'volume_create_manager' (1bc02053-2d75-4852-8bc8-ba92dc28c786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (469842cb-7747-4482-a3ae-e56321e6c0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (469842cb-7747-4482-a3ae-e56321e6c0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-53520668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9653a978-7884-48f8-a3fe-5880f50cf69a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dbea7d6ebb5e42029170f9803a35a032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:49Z,use_quota=True,user_id='db41984ff2df49dd8ae9ea5a0e5c8caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc486f1-e281-4197-ad95-5ed90d11c228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc486f1-e281-4197-ad95-5ed90d11c228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79796415-e0ef-462d-b7b0-8020e6282d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:49 devstack cinder-volume[87513]: DEBUG cinder.image.glance [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Creating Keystone auth plugin from conf {{(pid=87513) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 16:02:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79796415-e0ef-462d-b7b0-8020e6282d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9653a978-7884-48f8-a3fe-5880f50cf69a', 'volume_name': 'volume-9653a978-7884-48f8-a3fe-5880f50cf69a', 'volume_size': 1, 'image_id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '32b22b5244654820a43b7715eda03c1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae740f20-0377-46ce-8db7-60c9f17af945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae740f20-0377-46ce-8db7-60c9f17af945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c707ad40-a2ed-4b2a-9392-73bf58081f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:49 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Volume 9653a978-7884-48f8-a3fe-5880f50cf69a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9653a978-7884-48f8-a3fe-5880f50cf69a', 'volume_size': 1, 'image_id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '32b22b5244654820a43b7715eda03c1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 16:02:49 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Trying to clone 9653a978-7884-48f8-a3fe-5880f50cf69a from image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}]). {{(pid=87513) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 16:02:50 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_l1gr3ovddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 16:02:50 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Image download 20.69 MB at 20.69 MB/s Sep 04 16:02:50 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab42aa7f-9759-42d4-afa9-e6aa62419df1]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_l1gr3ovddevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:50 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_l1gr3ovddevstack@QuobyteHD Sep 04 16:02:50 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:50 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_l1gr3ovddevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:50 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Temporary image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 is fetched for user db41984ff2df49dd8ae9ea5a0e5c8caf. {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 16:02:50 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[540d1578-4ccf-4b56-bfea-3354649b444a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_l1gr3ovddevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:50 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_l1gr3ovddevstack@QuobyteHD Sep 04 16:02:50 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-ec653a1f-c73d-4b8d-8395-7d2210edcc4f req-4066ed96-d015-4d2c-ab0c-7888fa315def tempest-TestMinimumBasicScenario-354275421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-ec653a1f-c73d-4b8d-8395-7d2210edcc4f req-4066ed96-d015-4d2c-ab0c-7888fa315def tempest-TestMinimumBasicScenario-354275421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:51 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e7d0ca-fa60-4fd1-9944-91482dd75333]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-ec653a1f-c73d-4b8d-8395-7d2210edcc4f req-4066ed96-d015-4d2c-ab0c-7888fa315def tempest-TestMinimumBasicScenario-354275421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d089f584-df99-4b27-b100-c3ebd8d92c70 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:51 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_l1gr3ovddevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:51 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d089f584-df99-4b27-b100-c3ebd8d92c70 Sep 04 16:02:51 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:51 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-ec653a1f-c73d-4b8d-8395-7d2210edcc4f req-4066ed96-d015-4d2c-ab0c-7888fa315def tempest-TestMinimumBasicScenario-354275421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d089f584-df99-4b27-b100-c3ebd8d92c70" returned: 0 in 0.373s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-ec653a1f-c73d-4b8d-8395-7d2210edcc4f req-4066ed96-d015-4d2c-ab0c-7888fa315def tempest-TestMinimumBasicScenario-354275421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.395s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.260s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-53520668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9653a978-7884-48f8-a3fe-5880f50cf69a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dbea7d6ebb5e42029170f9803a35a032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:49Z,use_quota=True,user_id='db41984ff2df49dd8ae9ea5a0e5c8caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:02:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Creating volume 9653a978-7884-48f8-a3fe-5880f50cf69a {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:02:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:02:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:02:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:02:51 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:02:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:51 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a 1073741824 Sep 04 16:02:51 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-ec653a1f-c73d-4b8d-8395-7d2210edcc4f req-4066ed96-d015-4d2c-ab0c-7888fa315def tempest-TestMinimumBasicScenario-354275421 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-d089f584-df99-4b27-b100-c3ebd8d92c70', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16bcfa21-0b60-45e1-a11a-fbdb347c45a1', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 16:02:51 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-ec653a1f-c73d-4b8d-8395-7d2210edcc4f req-4066ed96-d015-4d2c-ab0c-7888fa315def tempest-TestMinimumBasicScenario-354275421 None] attachment_update completed successfully. Sep 04 16:02:52 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a 1073741824" returned: 0 in 0.505s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:52 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a Sep 04 16:02:52 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:52 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a" returned: 0 in 0.269s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:02:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:52 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Attempting download of 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}])) to volume 9653a978-7884-48f8-a3fe-5880f50cf69a. {{(pid=87513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 16:02:52 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e65b25f-7f31-49e2-a467-0298dfaf7bad]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_io5ko93u {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:52 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_io5ko93u Sep 04 16:02:52 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:52 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_io5ko93u" returned: 0 in 0.371s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_io5ko93u {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:52 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_io5ko93u Sep 04 16:02:52 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:53 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_io5ko93u" returned: 1 in 0.367s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_io5ko93u' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:02:53 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[87989689-e964-4784-9c20-577e794aa8de]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_l1gr3ovddevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:53 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_l1gr3ovddevstack@QuobyteHD Sep 04 16:02:53 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:53 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_l1gr3ovddevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:53 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 was qcow2, converting to raw {{(pid=87513) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 16:02:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_l1gr3ovddevstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:53 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_l1gr3ovddevstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a Sep 04 16:02:53 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:55 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_l1gr3ovddevstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a" returned: 0 in 1.669s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:55 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033_l1gr3ovddevstack@QuobyteHD, size 112.00 MB, duration 1.67 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:02:55 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Converted 112.00 MB image at 67.07 MB/s Sep 04 16:02:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:55 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a 1G Sep 04 16:02:55 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:55 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a 1G" returned: 0 in 0.283s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:55 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c4510d-15f2-4e62-ba5a-1ef68399a754]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:55 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a Sep 04 16:02:55 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:55 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a" returned: 0 in 0.392s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:56 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a Sep 04 16:02:56 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:56 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a" returned: 1 in 0.400s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:02:56 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Downloaded image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}])) to volume 9653a978-7884-48f8-a3fe-5880f50cf69a successfully. {{(pid=87513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 16:02:56 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Temporary image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 for user db41984ff2df49dd8ae9ea5a0e5c8caf is deleted. {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 16:02:56 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Marking volume 9653a978-7884-48f8-a3fe-5880f50cf69a as bootable. {{(pid=87513) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 16:02:56 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Copying metadata from image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 to 9653a978-7884-48f8-a3fe-5880f50cf69a. {{(pid=87513) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 16:02:56 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Creating volume glance metadata for volume 9653a978-7884-48f8-a3fe-5880f50cf69a backed by image 9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87513) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 16:02:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c707ad40-a2ed-4b2a-9392-73bf58081f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9653a978-7884-48f8-a3fe-5880f50cf69a', 'volume_size': 1, 'image_id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '32b22b5244654820a43b7715eda03c1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033', 'created_at': datetime.datetime(2026, 9, 4, 13, 43, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 43, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbbb1ca-bd40-4f4c-b2c0-6f9e7f98a033/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef50889c-dd7f-44e9-8f6c-4ed1103c1cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:56 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Volume volume-9653a978-7884-48f8-a3fe-5880f50cf69a (9653a978-7884-48f8-a3fe-5880f50cf69a): created successfully Sep 04 16:02:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef50889c-dd7f-44e9-8f6c-4ed1103c1cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Flow 'volume_create_manager' (1bc02053-2d75-4852-8bc8-ba92dc28c786) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:56 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e3c1ba02-237a-4a92-92bc-397bb01ef1f3 tempest-VolumesGetTest-1911326072 None] Created volume successfully. Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Flow 'volume_create_manager' (4aa4468a-468d-4626-8c5f-4875763118cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08fbe543-8d2a-4ced-963b-8dc8db84c5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08fbe543-8d2a-4ced-963b-8dc8db84c5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:02:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1155460538',display_name='tempest-VolumesGetTest-Volume-1489871154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f8450c-0c18-4f7a-9e96-df5e0c641e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbea7d6ebb5e42029170f9803a35a032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:58Z,use_quota=True,user_id='db41984ff2df49dd8ae9ea5a0e5c8caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cfd89d-d1ec-43c0-a524-fce885d630b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cfd89d-d1ec-43c0-a524-fce885d630b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ba949f-2be3-4aca-ba10-62a4ed2a8fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ba949f-2be3-4aca-ba10-62a4ed2a8fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29f8450c-0c18-4f7a-9e96-df5e0c641e9d', 'volume_name': 'volume-29f8450c-0c18-4f7a-9e96-df5e0c641e9d', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18feee9-8ca3-4199-bc44-f40b545edccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18feee9-8ca3-4199-bc44-f40b545edccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b9f5b8-806b-4561-a35d-6605273b428b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:58 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Volume 29f8450c-0c18-4f7a-9e96-df5e0c641e9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29f8450c-0c18-4f7a-9e96-df5e0c641e9d', 'volume_size': 1} Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:02:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1155460538',display_name='tempest-VolumesGetTest-Volume-1489871154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f8450c-0c18-4f7a-9e96-df5e0c641e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbea7d6ebb5e42029170f9803a35a032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:58Z,use_quota=True,user_id='db41984ff2df49dd8ae9ea5a0e5c8caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Creating volume 29f8450c-0c18-4f7a-9e96-df5e0c641e9d {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:02:58 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-29f8450c-0c18-4f7a-9e96-df5e0c641e9d 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:58 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-29f8450c-0c18-4f7a-9e96-df5e0c641e9d 1073741824 Sep 04 16:02:58 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:58 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-29f8450c-0c18-4f7a-9e96-df5e0c641e9d 1073741824" returned: 0 in 0.508s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-29f8450c-0c18-4f7a-9e96-df5e0c641e9d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:58 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-29f8450c-0c18-4f7a-9e96-df5e0c641e9d Sep 04 16:02:58 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:59 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-29f8450c-0c18-4f7a-9e96-df5e0c641e9d" returned: 0 in 0.255s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:02:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b9f5b8-806b-4561-a35d-6605273b428b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f8450c-0c18-4f7a-9e96-df5e0c641e9d', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc00883-6334-47e7-b3e6-3da2ac3fef7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:59 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Volume volume-29f8450c-0c18-4f7a-9e96-df5e0c641e9d (29f8450c-0c18-4f7a-9e96-df5e0c641e9d): created successfully Sep 04 16:02:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc00883-6334-47e7-b3e6-3da2ac3fef7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Flow 'volume_create_manager' (4aa4468a-468d-4626-8c5f-4875763118cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:59 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-73934626-0ef9-4b53-83af-7ded705156a2 tempest-VolumesGetTest-1911326072 None] Created volume successfully. Sep 04 16:03:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6e136c94-6aeb-44e2-ac1f-2dbbcc556259 tempest-VolumesGetTest-1911326072 None] Acquiring lock "cinder-29f8450c-0c18-4f7a-9e96-df5e0c641e9d-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:03:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6e136c94-6aeb-44e2-ac1f-2dbbcc556259 tempest-VolumesGetTest-1911326072 None] Lock "cinder-29f8450c-0c18-4f7a-9e96-df5e0c641e9d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:03:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6e136c94-6aeb-44e2-ac1f-2dbbcc556259 tempest-VolumesGetTest-1911326072 None] Acquiring lock "cinder-quobyte-29f8450c-0c18-4f7a-9e96-df5e0c641e9d" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:03:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6e136c94-6aeb-44e2-ac1f-2dbbcc556259 tempest-VolumesGetTest-1911326072 None] Lock "cinder-quobyte-29f8450c-0c18-4f7a-9e96-df5e0c641e9d" acquired by "delete_volume" :: waited 0.021s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:03:00 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e97e344-2362-4258-9e5b-59adf34e3cad]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:03:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6e136c94-6aeb-44e2-ac1f-2dbbcc556259 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-29f8450c-0c18-4f7a-9e96-df5e0c641e9d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:00 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-29f8450c-0c18-4f7a-9e96-df5e0c641e9d Sep 04 16:03:00 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:00 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6e136c94-6aeb-44e2-ac1f-2dbbcc556259 tempest-VolumesGetTest-1911326072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-29f8450c-0c18-4f7a-9e96-df5e0c641e9d" returned: 0 in 0.358s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6e136c94-6aeb-44e2-ac1f-2dbbcc556259 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-29f8450c-0c18-4f7a-9e96-df5e0c641e9d {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:00 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-29f8450c-0c18-4f7a-9e96-df5e0c641e9d Sep 04 16:03:00 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:01 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6e136c94-6aeb-44e2-ac1f-2dbbcc556259 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-29f8450c-0c18-4f7a-9e96-df5e0c641e9d" returned: 0 in 0.237s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6e136c94-6aeb-44e2-ac1f-2dbbcc556259 tempest-VolumesGetTest-1911326072 None] Lock "cinder-quobyte-29f8450c-0c18-4f7a-9e96-df5e0c641e9d" released by "delete_volume" :: held 0.635s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:03:01 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-6e136c94-6aeb-44e2-ac1f-2dbbcc556259 tempest-VolumesGetTest-1911326072 None] Created reservations ['a0b91c75-edf9-4fb8-8c81-e4080b844d22', '87f3dc4d-7667-4764-82fb-93914747348e', 'ad8ef273-38c6-453e-b734-e3ffa456acf9', '0fbccb61-d40d-483f-b67c-1aab7bc47ca7'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:03:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6e136c94-6aeb-44e2-ac1f-2dbbcc556259 tempest-VolumesGetTest-1911326072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6e136c94-6aeb-44e2-ac1f-2dbbcc556259 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:01 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6e136c94-6aeb-44e2-ac1f-2dbbcc556259 tempest-VolumesGetTest-1911326072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:03:01 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6e136c94-6aeb-44e2-ac1f-2dbbcc556259 tempest-VolumesGetTest-1911326072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:03:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6e136c94-6aeb-44e2-ac1f-2dbbcc556259 tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6e136c94-6aeb-44e2-ac1f-2dbbcc556259 tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:01 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:03:01 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:01 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6e136c94-6aeb-44e2-ac1f-2dbbcc556259 tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.240s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:01 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-6e136c94-6aeb-44e2-ac1f-2dbbcc556259 tempest-VolumesGetTest-1911326072 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:03:01 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-6e136c94-6aeb-44e2-ac1f-2dbbcc556259 tempest-VolumesGetTest-1911326072 None] Deleted volume successfully. Sep 04 16:03:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6e136c94-6aeb-44e2-ac1f-2dbbcc556259 tempest-VolumesGetTest-1911326072 None] Lock "cinder-29f8450c-0c18-4f7a-9e96-df5e0c641e9d-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:03:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] Acquiring lock "cinder-9653a978-7884-48f8-a3fe-5880f50cf69a-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:03:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] Lock "cinder-9653a978-7884-48f8-a3fe-5880f50cf69a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:03:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] Acquiring lock "cinder-quobyte-9653a978-7884-48f8-a3fe-5880f50cf69a" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:03:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] Lock "cinder-quobyte-9653a978-7884-48f8-a3fe-5880f50cf69a" acquired by "delete_volume" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:03:01 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b101d8-a551-41d7-81af-f6d0b51054b2]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:03:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:01 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a Sep 04 16:03:01 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:02 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a" returned: 0 in 0.336s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:02 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a Sep 04 16:03:02 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:02 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a" returned: 1 in 0.341s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:03:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:02 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a Sep 04 16:03:02 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:02 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9653a978-7884-48f8-a3fe-5880f50cf69a" returned: 0 in 0.229s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:02 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] Lock "cinder-quobyte-9653a978-7884-48f8-a3fe-5880f50cf69a" released by "delete_volume" :: held 0.962s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:03:02 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] Created reservations ['ea9fb48f-e059-4712-949e-60f3d0de71a7', 'bc7850ba-8e6a-496f-b7b0-bf3920efe51e', 'fb81f937-124e-4cb7-9a2c-0053816db227', '282038ed-f591-437f-b102-a920411c4328'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:03:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:03:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:03:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:02 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:03:02 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:02 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.247s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:02 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:03:02 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] Deleted volume successfully. Sep 04 16:03:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-08fb089c-b05b-4362-9b02-29f5d196305d tempest-VolumesGetTest-1911326072 None] Lock "cinder-9653a978-7884-48f8-a3fe-5880f50cf69a-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Flow 'volume_create_manager' (2dca961a-f28c-411f-9de9-f708b7ba3da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76cf701-f93c-4d37-8b2d-3c1b23110e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76cf701-f93c-4d37-8b2d-3c1b23110e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-166944633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bacbeda-c577-45d3-ada1-cad01b40506e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7607096a66f4ad893f32e273cd9704d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:03:07Z,use_quota=True,user_id='61b419b744f044efb7880fb590046c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5ca894-d554-4fb1-92bd-3d5a6acaf8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5ca894-d554-4fb1-92bd-3d5a6acaf8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee3db9a-59d0-4544-95de-faae565efbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee3db9a-59d0-4544-95de-faae565efbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bacbeda-c577-45d3-ada1-cad01b40506e', 'volume_name': 'volume-9bacbeda-c577-45d3-ada1-cad01b40506e', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8133fc3e-e018-496c-9948-3c10d7bedeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8133fc3e-e018-496c-9948-3c10d7bedeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f46b8e83-0808-44a6-b667-371308bd2fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:06 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Volume 9bacbeda-c577-45d3-ada1-cad01b40506e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bacbeda-c577-45d3-ada1-cad01b40506e', 'volume_size': 1} Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-166944633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bacbeda-c577-45d3-ada1-cad01b40506e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7607096a66f4ad893f32e273cd9704d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:03:07Z,use_quota=True,user_id='61b419b744f044efb7880fb590046c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Creating volume 9bacbeda-c577-45d3-ada1-cad01b40506e {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:03:06 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:03:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9bacbeda-c577-45d3-ada1-cad01b40506e 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:06 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9bacbeda-c577-45d3-ada1-cad01b40506e 1073741824 Sep 04 16:03:06 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:07 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9bacbeda-c577-45d3-ada1-cad01b40506e 1073741824" returned: 0 in 0.414s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9bacbeda-c577-45d3-ada1-cad01b40506e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:07 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9bacbeda-c577-45d3-ada1-cad01b40506e Sep 04 16:03:07 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:07 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9bacbeda-c577-45d3-ada1-cad01b40506e" returned: 0 in 0.230s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:03:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f46b8e83-0808-44a6-b667-371308bd2fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bacbeda-c577-45d3-ada1-cad01b40506e', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e64105-4c50-410e-9daf-b231ab709f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:07 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Volume volume-9bacbeda-c577-45d3-ada1-cad01b40506e (9bacbeda-c577-45d3-ada1-cad01b40506e): created successfully Sep 04 16:03:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e64105-4c50-410e-9daf-b231ab709f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Flow 'volume_create_manager' (2dca961a-f28c-411f-9de9-f708b7ba3da8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:03:07 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-944871a0-4718-48c7-b737-610debb3b1a2 tempest-VolumesNegativeTest-1468710885 None] Created volume successfully. Sep 04 16:03:17 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=54,cinder:INSERT=23,cinder:UPDATE=61,cinder:DELETE=5 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:03:17 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=51,cinder:UPDATE=63,cinder:INSERT=18,cinder:DELETE=6 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:03:23 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2f16d3c1-d1cb-4cf9-8624-1f06296143fa tempest-VolumesNegativeTest-1468710885 None] Acquiring lock "cinder-9bacbeda-c577-45d3-ada1-cad01b40506e-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:03:23 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2f16d3c1-d1cb-4cf9-8624-1f06296143fa tempest-VolumesNegativeTest-1468710885 None] Lock "cinder-9bacbeda-c577-45d3-ada1-cad01b40506e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:03:24 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2f16d3c1-d1cb-4cf9-8624-1f06296143fa tempest-VolumesNegativeTest-1468710885 None] Acquiring lock "cinder-quobyte-9bacbeda-c577-45d3-ada1-cad01b40506e" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:03:24 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2f16d3c1-d1cb-4cf9-8624-1f06296143fa tempest-VolumesNegativeTest-1468710885 None] Lock "cinder-quobyte-9bacbeda-c577-45d3-ada1-cad01b40506e" acquired by "delete_volume" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:03:24 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36d135c-c889-4cbb-99c3-77df31514d6d]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:03:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2f16d3c1-d1cb-4cf9-8624-1f06296143fa tempest-VolumesNegativeTest-1468710885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9bacbeda-c577-45d3-ada1-cad01b40506e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:24 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9bacbeda-c577-45d3-ada1-cad01b40506e Sep 04 16:03:24 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:24 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2f16d3c1-d1cb-4cf9-8624-1f06296143fa tempest-VolumesNegativeTest-1468710885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9bacbeda-c577-45d3-ada1-cad01b40506e" returned: 0 in 0.361s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2f16d3c1-d1cb-4cf9-8624-1f06296143fa tempest-VolumesNegativeTest-1468710885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9bacbeda-c577-45d3-ada1-cad01b40506e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:24 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9bacbeda-c577-45d3-ada1-cad01b40506e Sep 04 16:03:24 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:24 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2f16d3c1-d1cb-4cf9-8624-1f06296143fa tempest-VolumesNegativeTest-1468710885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9bacbeda-c577-45d3-ada1-cad01b40506e" returned: 0 in 0.243s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:24 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2f16d3c1-d1cb-4cf9-8624-1f06296143fa tempest-VolumesNegativeTest-1468710885 None] Lock "cinder-quobyte-9bacbeda-c577-45d3-ada1-cad01b40506e" released by "delete_volume" :: held 0.648s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:03:24 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-2f16d3c1-d1cb-4cf9-8624-1f06296143fa tempest-VolumesNegativeTest-1468710885 None] Created reservations ['71012d24-9e99-45d2-ae3b-87d2ed9d2bc2', '96b6180c-4ab9-4a0f-9c2d-9e294922dd56', '697d69b7-3bef-4edf-8710-586181a0d0b9', '75519405-0916-489c-8b54-8be4f20f4ec9'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:03:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2f16d3c1-d1cb-4cf9-8624-1f06296143fa tempest-VolumesNegativeTest-1468710885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2f16d3c1-d1cb-4cf9-8624-1f06296143fa tempest-VolumesNegativeTest-1468710885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:24 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2f16d3c1-d1cb-4cf9-8624-1f06296143fa tempest-VolumesNegativeTest-1468710885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:03:24 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2f16d3c1-d1cb-4cf9-8624-1f06296143fa tempest-VolumesNegativeTest-1468710885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:03:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2f16d3c1-d1cb-4cf9-8624-1f06296143fa tempest-VolumesNegativeTest-1468710885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2f16d3c1-d1cb-4cf9-8624-1f06296143fa tempest-VolumesNegativeTest-1468710885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:24 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:03:24 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:25 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2f16d3c1-d1cb-4cf9-8624-1f06296143fa tempest-VolumesNegativeTest-1468710885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.239s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:25 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-2f16d3c1-d1cb-4cf9-8624-1f06296143fa tempest-VolumesNegativeTest-1468710885 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:03:25 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-2f16d3c1-d1cb-4cf9-8624-1f06296143fa tempest-VolumesNegativeTest-1468710885 None] Deleted volume successfully. Sep 04 16:03:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2f16d3c1-d1cb-4cf9-8624-1f06296143fa tempest-VolumesNegativeTest-1468710885 None] Lock "cinder-9bacbeda-c577-45d3-ada1-cad01b40506e-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Flow 'volume_create_manager' (5223ab71-dca8-4ac7-9810-7ec1d66664e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b859179-e33e-4f5b-8a12-07ac9df9ab51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b859179-e33e-4f5b-8a12-07ac9df9ab51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1476845518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c326a955-0160-4b43-81d5-5fc6f54883e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='482c7bd299a74e368bee059db82e9f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:03:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:03:28Z,use_quota=True,user_id='c3ea508f6d0d45dba451055c3009dc4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2bdf56-4d9e-4fd2-86d1-5ce2a0def94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2bdf56-4d9e-4fd2-86d1-5ce2a0def94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de06116-047a-4fdb-8254-06961cdc168e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de06116-047a-4fdb-8254-06961cdc168e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c326a955-0160-4b43-81d5-5fc6f54883e8', 'volume_name': 'volume-c326a955-0160-4b43-81d5-5fc6f54883e8', 'volume_size': 2}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78574d0-a4cb-4c98-bc2d-1698b60317af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78574d0-a4cb-4c98-bc2d-1698b60317af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced3cffc-9e5b-43b6-8035-75ae27036bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:27 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Volume c326a955-0160-4b43-81d5-5fc6f54883e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c326a955-0160-4b43-81d5-5fc6f54883e8', 'volume_size': 2} Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1476845518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c326a955-0160-4b43-81d5-5fc6f54883e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='482c7bd299a74e368bee059db82e9f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:03:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:03:28Z,use_quota=True,user_id='c3ea508f6d0d45dba451055c3009dc4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Creating volume c326a955-0160-4b43-81d5-5fc6f54883e8 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:03:27 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:03:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8 2147483648 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:27 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8 2147483648 Sep 04 16:03:27 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:28 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8 2147483648" returned: 0 in 0.450s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:28 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8 Sep 04 16:03:28 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:28 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8" returned: 0 in 0.240s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:03:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced3cffc-9e5b-43b6-8035-75ae27036bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c326a955-0160-4b43-81d5-5fc6f54883e8', 'volume_size': 2}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c6c543-09e8-468c-9887-b3c70a93c71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:28 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Volume volume-c326a955-0160-4b43-81d5-5fc6f54883e8 (c326a955-0160-4b43-81d5-5fc6f54883e8): created successfully Sep 04 16:03:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c6c543-09e8-468c-9887-b3c70a93c71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Flow 'volume_create_manager' (5223ab71-dca8-4ac7-9810-7ec1d66664e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:03:28 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-c89a88e7-f2c8-4cc7-ad35-8fd2a8c92477 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Created volume successfully. Sep 04 16:03:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-478d3db0-f84f-432d-b9a7-6969824d3fb0 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-478d3db0-f84f-432d-b9a7-6969824d3fb0 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:29 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-478d3db0-f84f-432d-b9a7-6969824d3fb0 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Creating offline snapshot 0120b8de-f4b3-4b15-be66-f4a3923e2b04 of volume c326a955-0160-4b43-81d5-5fc6f54883e8 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:03:29 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[02014dc4-eecf-4105-b6d9-3baa55e240a8]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:03:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-478d3db0-f84f-432d-b9a7-6969824d3fb0 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:29 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8 Sep 04 16:03:29 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:29 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-478d3db0-f84f-432d-b9a7-6969824d3fb0 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8" returned: 0 in 0.351s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-478d3db0-f84f-432d-b9a7-6969824d3fb0 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.0120b8de-f4b3-4b15-be66-f4a3923e2b04 2G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:29 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.0120b8de-f4b3-4b15-be66-f4a3923e2b04 2G Sep 04 16:03:29 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:29 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-478d3db0-f84f-432d-b9a7-6969824d3fb0 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.0120b8de-f4b3-4b15-be66-f4a3923e2b04 2G" returned: 0 in 0.382s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-478d3db0-f84f-432d-b9a7-6969824d3fb0 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c326a955-0160-4b43-81d5-5fc6f54883e8 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.0120b8de-f4b3-4b15-be66-f4a3923e2b04 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:29 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c326a955-0160-4b43-81d5-5fc6f54883e8 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.0120b8de-f4b3-4b15-be66-f4a3923e2b04 Sep 04 16:03:29 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:30 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-478d3db0-f84f-432d-b9a7-6969824d3fb0 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c326a955-0160-4b43-81d5-5fc6f54883e8 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.0120b8de-f4b3-4b15-be66-f4a3923e2b04" returned: 0 in 0.287s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:30 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-478d3db0-f84f-432d-b9a7-6969824d3fb0 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.0120b8de-f4b3-4b15-be66-f4a3923e2b04 is being set with open permissions: ugo+rw Sep 04 16:03:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-478d3db0-f84f-432d-b9a7-6969824d3fb0 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.0120b8de-f4b3-4b15-be66-f4a3923e2b04 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:30 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.0120b8de-f4b3-4b15-be66-f4a3923e2b04 Sep 04 16:03:30 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:30 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-478d3db0-f84f-432d-b9a7-6969824d3fb0 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.0120b8de-f4b3-4b15-be66-f4a3923e2b04" returned: 0 in 0.241s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-478d3db0-f84f-432d-b9a7-6969824d3fb0 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:30 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.info Sep 04 16:03:30 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:30 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-478d3db0-f84f-432d-b9a7-6969824d3fb0 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.info" returned: 0 in 0.237s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:30 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-478d3db0-f84f-432d-b9a7-6969824d3fb0 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.info is being set with open permissions: ugo+rw Sep 04 16:03:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-478d3db0-f84f-432d-b9a7-6969824d3fb0 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:30 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.info Sep 04 16:03:30 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:30 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-478d3db0-f84f-432d-b9a7-6969824d3fb0 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.info" returned: 0 in 0.246s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-478d3db0-f84f-432d-b9a7-6969824d3fb0 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.831s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:30 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-478d3db0-f84f-432d-b9a7-6969824d3fb0 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Create snapshot completed successfully Sep 04 16:03:31 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Acquiring lock "cinder-0120b8de-f4b3-4b15-be66-f4a3923e2b04-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:03:31 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Lock "cinder-0120b8de-f4b3-4b15-be66-f4a3923e2b04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:03:31 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Acquiring lock "cinder-quobyte-c326a955-0160-4b43-81d5-5fc6f54883e8" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:03:31 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Lock "cinder-quobyte-c326a955-0160-4b43-81d5-5fc6f54883e8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:03:31 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Acquiring lock "cinder-quobyte-0120b8de-f4b3-4b15-be66-f4a3923e2b04" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:03:31 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Lock "cinder-quobyte-0120b8de-f4b3-4b15-be66-f4a3923e2b04" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:03:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Deleting offline snapshot 0120b8de-f4b3-4b15-be66-f4a3923e2b04 of volume c326a955-0160-4b43-81d5-5fc6f54883e8 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:03:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] snapshot_file for this snap is: volume-c326a955-0160-4b43-81d5-5fc6f54883e8.0120b8de-f4b3-4b15-be66-f4a3923e2b04 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:03:31 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[492d1c76-f1e4-48ee-8357-b14f1fad6fee]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:03:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.0120b8de-f4b3-4b15-be66-f4a3923e2b04 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:31 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.0120b8de-f4b3-4b15-be66-f4a3923e2b04 Sep 04 16:03:31 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:31 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.0120b8de-f4b3-4b15-be66-f4a3923e2b04" returned: 0 in 0.339s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c326a955-0160-4b43-81d5-5fc6f54883e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:03:31 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad36546f-1779-4d8a-b247-46708922d926]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:03:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:31 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8 Sep 04 16:03:31 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:32 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8" returned: 0 in 0.348s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.0120b8de-f4b3-4b15-be66-f4a3923e2b04 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:32 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.0120b8de-f4b3-4b15-be66-f4a3923e2b04 Sep 04 16:03:32 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:32 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.0120b8de-f4b3-4b15-be66-f4a3923e2b04" returned: 0 in 0.336s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.0120b8de-f4b3-4b15-be66-f4a3923e2b04 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:32 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.0120b8de-f4b3-4b15-be66-f4a3923e2b04 Sep 04 16:03:32 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:32 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8.0120b8de-f4b3-4b15-be66-f4a3923e2b04" returned: 0 in 0.240s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Lock "cinder-quobyte-0120b8de-f4b3-4b15-be66-f4a3923e2b04" released by "_delete_snapshot" :: held 1.357s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:03:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Lock "cinder-quobyte-c326a955-0160-4b43-81d5-5fc6f54883e8" released by "delete_snapshot" :: held 1.379s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:03:32 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Created reservations ['085d3184-470a-4efa-ab0c-d296e30c8465', 'e09d5ce7-124b-4475-802e-51213f5c11c7', 'a5652b2f-bcfc-46cd-9c21-9bb666db9f79', 'ed8a4cc0-7c23-4361-a854-c2828e15db80'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:03:32 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Delete snapshot completed successfully. Sep 04 16:03:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-146aa1cd-318a-4de5-8bbd-5afa14c33339 tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Lock "cinder-0120b8de-f4b3-4b15-be66-f4a3923e2b04-delete_snapshot" released by "delete_snapshot" :: held 1.510s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:03:33 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e823ec10-292e-46bd-9a02-0c534e935d5e tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Acquiring lock "cinder-c326a955-0160-4b43-81d5-5fc6f54883e8-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:03:33 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e823ec10-292e-46bd-9a02-0c534e935d5e tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Lock "cinder-c326a955-0160-4b43-81d5-5fc6f54883e8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:03:33 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e823ec10-292e-46bd-9a02-0c534e935d5e tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Acquiring lock "cinder-quobyte-c326a955-0160-4b43-81d5-5fc6f54883e8" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:03:33 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e823ec10-292e-46bd-9a02-0c534e935d5e tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Lock "cinder-quobyte-c326a955-0160-4b43-81d5-5fc6f54883e8" acquired by "delete_volume" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:03:33 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[82482bfc-0c83-4af0-ab1d-be7c70a87617]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:03:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e823ec10-292e-46bd-9a02-0c534e935d5e tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:33 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8 Sep 04 16:03:33 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:33 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e823ec10-292e-46bd-9a02-0c534e935d5e tempest-VolumesSnapshotNegativeTestJSON-25438866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8" returned: 0 in 0.388s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e823ec10-292e-46bd-9a02-0c534e935d5e tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:33 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8 Sep 04 16:03:33 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:34 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e823ec10-292e-46bd-9a02-0c534e935d5e tempest-VolumesSnapshotNegativeTestJSON-25438866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c326a955-0160-4b43-81d5-5fc6f54883e8" returned: 0 in 0.241s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e823ec10-292e-46bd-9a02-0c534e935d5e tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Lock "cinder-quobyte-c326a955-0160-4b43-81d5-5fc6f54883e8" released by "delete_volume" :: held 0.685s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:03:34 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-e823ec10-292e-46bd-9a02-0c534e935d5e tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Created reservations ['63384a18-45af-48bb-a0df-359edfe1ee3b', 'cd52e67d-451a-4375-8e1d-9382b45ffd68', '4f6caf42-2f35-42a2-9464-0df5ac153ec2', '28c8a5c4-0620-4918-b676-8564e9eeed66'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:03:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e823ec10-292e-46bd-9a02-0c534e935d5e tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e823ec10-292e-46bd-9a02-0c534e935d5e tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e823ec10-292e-46bd-9a02-0c534e935d5e tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:03:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e823ec10-292e-46bd-9a02-0c534e935d5e tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:03:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e823ec10-292e-46bd-9a02-0c534e935d5e tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e823ec10-292e-46bd-9a02-0c534e935d5e tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:34 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:03:34 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:34 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e823ec10-292e-46bd-9a02-0c534e935d5e tempest-VolumesSnapshotNegativeTestJSON-25438866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.266s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:34 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-e823ec10-292e-46bd-9a02-0c534e935d5e tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:03:34 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e823ec10-292e-46bd-9a02-0c534e935d5e tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Deleted volume successfully. Sep 04 16:03:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e823ec10-292e-46bd-9a02-0c534e935d5e tempest-VolumesSnapshotNegativeTestJSON-25438866 None] Lock "cinder-c326a955-0160-4b43-81d5-5fc6f54883e8-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:03:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:03:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:03:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:03:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:34 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:03:34 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:35 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.277s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:03:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:03:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 28 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:03:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 16:03:39 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-939db34a-41c8-4299-99fd-1f6cb3caaee4 req-d4a82aa7-3dd3-408a-83ae-98fac28df65c tempest-TestMinimumBasicScenario-354275421 None] Terminate volume connection completed successfully. Sep 04 16:03:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-939db34a-41c8-4299-99fd-1f6cb3caaee4 req-d4a82aa7-3dd3-408a-83ae-98fac28df65c tempest-TestMinimumBasicScenario-354275421 None] Deleting attachment 16bcfa21-0b60-45e1-a11a-fbdb347c45a1. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 16:03:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8c4bee08-8e94-4e16-b3e7-bb0338e14b15 tempest-TestMinimumBasicScenario-354275421 None] Acquiring lock "cinder-d089f584-df99-4b27-b100-c3ebd8d92c70-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:03:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8c4bee08-8e94-4e16-b3e7-bb0338e14b15 tempest-TestMinimumBasicScenario-354275421 None] Lock "cinder-d089f584-df99-4b27-b100-c3ebd8d92c70-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:03:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8c4bee08-8e94-4e16-b3e7-bb0338e14b15 tempest-TestMinimumBasicScenario-354275421 None] Acquiring lock "cinder-quobyte-d089f584-df99-4b27-b100-c3ebd8d92c70" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:03:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8c4bee08-8e94-4e16-b3e7-bb0338e14b15 tempest-TestMinimumBasicScenario-354275421 None] Lock "cinder-quobyte-d089f584-df99-4b27-b100-c3ebd8d92c70" acquired by "delete_volume" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:03:40 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[b033e898-a29c-4839-b913-f1b625b7b15b]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:03:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8c4bee08-8e94-4e16-b3e7-bb0338e14b15 tempest-TestMinimumBasicScenario-354275421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d089f584-df99-4b27-b100-c3ebd8d92c70 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:40 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d089f584-df99-4b27-b100-c3ebd8d92c70 Sep 04 16:03:40 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:40 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8c4bee08-8e94-4e16-b3e7-bb0338e14b15 tempest-TestMinimumBasicScenario-354275421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d089f584-df99-4b27-b100-c3ebd8d92c70" returned: 0 in 0.382s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8c4bee08-8e94-4e16-b3e7-bb0338e14b15 tempest-TestMinimumBasicScenario-354275421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d089f584-df99-4b27-b100-c3ebd8d92c70 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:40 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d089f584-df99-4b27-b100-c3ebd8d92c70 Sep 04 16:03:40 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:40 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8c4bee08-8e94-4e16-b3e7-bb0338e14b15 tempest-TestMinimumBasicScenario-354275421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d089f584-df99-4b27-b100-c3ebd8d92c70" returned: 0 in 0.294s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8c4bee08-8e94-4e16-b3e7-bb0338e14b15 tempest-TestMinimumBasicScenario-354275421 None] Lock "cinder-quobyte-d089f584-df99-4b27-b100-c3ebd8d92c70" released by "delete_volume" :: held 0.716s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:03:41 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-8c4bee08-8e94-4e16-b3e7-bb0338e14b15 tempest-TestMinimumBasicScenario-354275421 None] Created reservations ['31381ca1-b7cb-4e9c-98aa-09a1c42a964b', '04d0280e-1ab0-4ab2-b713-5d117ba7c55b', '9944d11f-2428-4249-b74a-da38ea2c73f4', '9210b6a2-2adb-46e7-bd3d-deb2feb8b74d'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:03:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8c4bee08-8e94-4e16-b3e7-bb0338e14b15 tempest-TestMinimumBasicScenario-354275421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8c4bee08-8e94-4e16-b3e7-bb0338e14b15 tempest-TestMinimumBasicScenario-354275421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:41 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8c4bee08-8e94-4e16-b3e7-bb0338e14b15 tempest-TestMinimumBasicScenario-354275421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:03:41 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8c4bee08-8e94-4e16-b3e7-bb0338e14b15 tempest-TestMinimumBasicScenario-354275421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:03:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8c4bee08-8e94-4e16-b3e7-bb0338e14b15 tempest-TestMinimumBasicScenario-354275421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8c4bee08-8e94-4e16-b3e7-bb0338e14b15 tempest-TestMinimumBasicScenario-354275421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:41 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:03:41 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:41 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8c4bee08-8e94-4e16-b3e7-bb0338e14b15 tempest-TestMinimumBasicScenario-354275421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.302s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:41 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-8c4bee08-8e94-4e16-b3e7-bb0338e14b15 tempest-TestMinimumBasicScenario-354275421 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:03:41 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-8c4bee08-8e94-4e16-b3e7-bb0338e14b15 tempest-TestMinimumBasicScenario-354275421 None] Deleted volume successfully. Sep 04 16:03:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8c4bee08-8e94-4e16-b3e7-bb0338e14b15 tempest-TestMinimumBasicScenario-354275421 None] Lock "cinder-d089f584-df99-4b27-b100-c3ebd8d92c70-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:03:51 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=32,cinder:SELECT=30,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:03:53 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=25,cinder:INSERT=10,cinder:UPDATE=37,cinder:DELETE=4 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Flow 'volume_create_manager' (9351fd43-727e-4898-ac85-c7f401ee813c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df967530-c686-4751-8e78-9b19a0611dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df967530-c686-4751-8e78-9b19a0611dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1541741355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54c94ef-38d3-454b-943c-5614b1260841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c477b230ddf441ea66fed24aeed2276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:03:59Z,use_quota=True,user_id='439d1f9dc06f4ba8b238b44e1561089e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faccaf15-a580-4529-bf59-36244eb725cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faccaf15-a580-4529-bf59-36244eb725cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e3450a-c4a5-4eac-8d56-20802117b720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e3450a-c4a5-4eac-8d56-20802117b720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54c94ef-38d3-454b-943c-5614b1260841', 'volume_name': 'volume-b54c94ef-38d3-454b-943c-5614b1260841', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec818086-b1a4-4e85-a325-bda72e8fa1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec818086-b1a4-4e85-a325-bda72e8fa1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f2a16d4-4481-4ca6-bd96-f231433617d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:59 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Volume b54c94ef-38d3-454b-943c-5614b1260841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54c94ef-38d3-454b-943c-5614b1260841', 'volume_size': 1} Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1541741355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54c94ef-38d3-454b-943c-5614b1260841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c477b230ddf441ea66fed24aeed2276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:03:59Z,use_quota=True,user_id='439d1f9dc06f4ba8b238b44e1561089e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Creating volume b54c94ef-38d3-454b-943c-5614b1260841 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:03:59 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:03:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b54c94ef-38d3-454b-943c-5614b1260841 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:59 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b54c94ef-38d3-454b-943c-5614b1260841 1073741824 Sep 04 16:03:59 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:00 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b54c94ef-38d3-454b-943c-5614b1260841 1073741824" returned: 0 in 0.437s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b54c94ef-38d3-454b-943c-5614b1260841 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:00 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b54c94ef-38d3-454b-943c-5614b1260841 Sep 04 16:04:00 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:00 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b54c94ef-38d3-454b-943c-5614b1260841" returned: 0 in 0.298s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:00 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:04:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:00 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f2a16d4-4481-4ca6-bd96-f231433617d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54c94ef-38d3-454b-943c-5614b1260841', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:00 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d00fd07-eb4c-437d-894f-2e191a3c99d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:00 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Volume volume-b54c94ef-38d3-454b-943c-5614b1260841 (b54c94ef-38d3-454b-943c-5614b1260841): created successfully Sep 04 16:04:00 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d00fd07-eb4c-437d-894f-2e191a3c99d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:00 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Flow 'volume_create_manager' (9351fd43-727e-4898-ac85-c7f401ee813c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:00 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-4b466b26-beeb-4ff4-a779-574c74fcd32c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Created volume successfully. Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Flow 'volume_create_manager' (a8edcd5d-8e82-4529-98b5-fd96aaef8733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd22bded-e38e-4283-90e3-182ab566d830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd22bded-e38e-4283-90e3-182ab566d830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-761419753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c477b230ddf441ea66fed24aeed2276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:01Z,use_quota=True,user_id='439d1f9dc06f4ba8b238b44e1561089e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e63799d-2197-42f1-bfa5-f33908fd185d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e63799d-2197-42f1-bfa5-f33908fd185d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624dcc1f-2b00-4308-9f24-542347ea26de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624dcc1f-2b00-4308-9f24-542347ea26de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2', 'volume_name': 'volume-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f0df98-63fd-4d10-ab4b-3cd56e3cd28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f0df98-63fd-4d10-ab4b-3cd56e3cd28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1e507c-cb25-4b0f-9afc-43a52db673fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:01 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Volume ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2', 'volume_size': 1} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-761419753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c477b230ddf441ea66fed24aeed2276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:01Z,use_quota=True,user_id='439d1f9dc06f4ba8b238b44e1561089e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Creating volume ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:04:01 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:01 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2 1073741824 Sep 04 16:04:01 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Flow 'volume_create_manager' (728f266b-34e7-41e8-ba7f-0aef5af9e74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c647b0c1-deb9-4d26-8818-8e5017457323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c647b0c1-deb9-4d26-8818-8e5017457323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-953538305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb531bf-6059-40fa-931b-9022306b88fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c477b230ddf441ea66fed24aeed2276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:02Z,use_quota=True,user_id='439d1f9dc06f4ba8b238b44e1561089e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8212e804-8bf3-45b9-a44c-61ebb52386bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8212e804-8bf3-45b9-a44c-61ebb52386bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89cc9466-aa62-4321-b418-cbba3f86a76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89cc9466-aa62-4321-b418-cbba3f86a76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfb531bf-6059-40fa-931b-9022306b88fa', 'volume_name': 'volume-bfb531bf-6059-40fa-931b-9022306b88fa', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:01 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d8dd623-d69e-47f3-9ecb-613ce0f76ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d8dd623-d69e-47f3-9ecb-613ce0f76ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e22dde2-e3cb-46f8-b046-31dbdbdcedc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:01 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Volume bfb531bf-6059-40fa-931b-9022306b88fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfb531bf-6059-40fa-931b-9022306b88fa', 'volume_size': 1} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2 1073741824" returned: 0 in 0.593s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:01 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2 Sep 04 16:04:01 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Flow 'volume_create_manager' (62884c41-49ec-4bda-bb89-06a669035f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f456be41-f95e-4b50-973b-dcc21293c6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f456be41-f95e-4b50-973b-dcc21293c6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-116718303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53533872-86e0-40a5-bdab-734fa88433b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c477b230ddf441ea66fed24aeed2276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:02Z,use_quota=True,user_id='439d1f9dc06f4ba8b238b44e1561089e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7d99b6-3d34-4349-8ba3-c358e1294663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7d99b6-3d34-4349-8ba3-c358e1294663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe369448-5662-42c5-a246-a172eb66c0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe369448-5662-42c5-a246-a172eb66c0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53533872-86e0-40a5-bdab-734fa88433b7', 'volume_name': 'volume-53533872-86e0-40a5-bdab-734fa88433b7', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b738509-85bf-4d9a-82fb-1ec204f38f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b738509-85bf-4d9a-82fb-1ec204f38f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98aabdc-bec1-42a0-81dc-de76beb5b197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:02 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Volume 53533872-86e0-40a5-bdab-734fa88433b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53533872-86e0-40a5-bdab-734fa88433b7', 'volume_size': 1} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:02 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2" returned: 0 in 0.322s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.363s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-953538305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb531bf-6059-40fa-931b-9022306b88fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c477b230ddf441ea66fed24aeed2276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:02Z,use_quota=True,user_id='439d1f9dc06f4ba8b238b44e1561089e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Creating volume bfb531bf-6059-40fa-931b-9022306b88fa {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:04:02 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bfb531bf-6059-40fa-931b-9022306b88fa 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1e507c-cb25-4b0f-9afc-43a52db673fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9a2ac7-debf-4c50-ad6d-1e054200fcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:02 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bfb531bf-6059-40fa-931b-9022306b88fa 1073741824 Sep 04 16:04:02 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:02 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Volume volume-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2 (ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2): created successfully Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9a2ac7-debf-4c50-ad6d-1e054200fcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Flow 'volume_create_manager' (a8edcd5d-8e82-4529-98b5-fd96aaef8733) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:02 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-de342d63-12cb-4be5-9676-6cc9542faa33 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Created volume successfully. Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Flow 'volume_create_manager' (673bfacf-ce91-4036-8b74-5eb8de67a609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19fe462-d8bc-4247-8827-52ee1281b1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19fe462-d8bc-4247-8827-52ee1281b1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-705042667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7e2434-3296-4247-a24b-3e5d111becf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c477b230ddf441ea66fed24aeed2276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:02Z,use_quota=True,user_id='439d1f9dc06f4ba8b238b44e1561089e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e27f02d-9398-4653-b7cc-83f3c600e7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e27f02d-9398-4653-b7cc-83f3c600e7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f764f55-788b-4130-a1af-1850554463d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f764f55-788b-4130-a1af-1850554463d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de7e2434-3296-4247-a24b-3e5d111becf1', 'volume_name': 'volume-de7e2434-3296-4247-a24b-3e5d111becf1', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a4f982-6231-4343-864d-0673fe2387a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a4f982-6231-4343-864d-0673fe2387a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acf0e25-77c1-4afe-98d8-d05d63cedede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:02 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Volume de7e2434-3296-4247-a24b-3e5d111becf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de7e2434-3296-4247-a24b-3e5d111becf1', 'volume_size': 1} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:02 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bfb531bf-6059-40fa-931b-9022306b88fa 1073741824" returned: 0 in 0.642s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Flow 'volume_create_manager' (c66b10b6-4db5-4d53-8f5e-dfe8604b8a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b55d208-23e8-41d7-8498-43b33442824c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b55d208-23e8-41d7-8498-43b33442824c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1092272362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0c464a-983c-439c-b5bb-ab352d5410ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c477b230ddf441ea66fed24aeed2276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:03Z,use_quota=True,user_id='439d1f9dc06f4ba8b238b44e1561089e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be21d23a-a362-46d9-b201-f29f086ee8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be21d23a-a362-46d9-b201-f29f086ee8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b45f3117-e7c4-44da-9fcd-48209e264add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b45f3117-e7c4-44da-9fcd-48209e264add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef0c464a-983c-439c-b5bb-ab352d5410ac', 'volume_name': 'volume-ef0c464a-983c-439c-b5bb-ab352d5410ac', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10588df1-0b6b-449c-808d-a09670eb84e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10588df1-0b6b-449c-808d-a09670eb84e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522e6100-2d90-4ac1-a2d9-3f2f799a186d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:02 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Volume ef0c464a-983c-439c-b5bb-ab352d5410ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef0c464a-983c-439c-b5bb-ab352d5410ac', 'volume_size': 1} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bfb531bf-6059-40fa-931b-9022306b88fa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:02 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bfb531bf-6059-40fa-931b-9022306b88fa Sep 04 16:04:02 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:03 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bfb531bf-6059-40fa-931b-9022306b88fa" returned: 0 in 0.270s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.095s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-116718303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53533872-86e0-40a5-bdab-734fa88433b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c477b230ddf441ea66fed24aeed2276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:02Z,use_quota=True,user_id='439d1f9dc06f4ba8b238b44e1561089e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Creating volume 53533872-86e0-40a5-bdab-734fa88433b7 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:04:03 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-53533872-86e0-40a5-bdab-734fa88433b7 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:03 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-53533872-86e0-40a5-bdab-734fa88433b7 1073741824 Sep 04 16:04:03 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e22dde2-e3cb-46f8-b046-31dbdbdcedc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfb531bf-6059-40fa-931b-9022306b88fa', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72dda90-4578-435d-bb9e-1b9ca25fb949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:03 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Volume volume-bfb531bf-6059-40fa-931b-9022306b88fa (bfb531bf-6059-40fa-931b-9022306b88fa): created successfully Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72dda90-4578-435d-bb9e-1b9ca25fb949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Flow 'volume_create_manager' (728f266b-34e7-41e8-ba7f-0aef5af9e74f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:03 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-a87c0855-9207-4cfa-ba0f-6e4026ea52ed tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Created volume successfully. Sep 04 16:04:03 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-53533872-86e0-40a5-bdab-734fa88433b7 1073741824" returned: 0 in 0.503s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-53533872-86e0-40a5-bdab-734fa88433b7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:03 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-53533872-86e0-40a5-bdab-734fa88433b7 Sep 04 16:04:03 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:03 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-53533872-86e0-40a5-bdab-734fa88433b7" returned: 0 in 0.256s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.501s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-705042667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7e2434-3296-4247-a24b-3e5d111becf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c477b230ddf441ea66fed24aeed2276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:02Z,use_quota=True,user_id='439d1f9dc06f4ba8b238b44e1561089e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Creating volume de7e2434-3296-4247-a24b-3e5d111becf1 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:04:03 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-de7e2434-3296-4247-a24b-3e5d111becf1 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98aabdc-bec1-42a0-81dc-de76beb5b197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53533872-86e0-40a5-bdab-734fa88433b7', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:04 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-de7e2434-3296-4247-a24b-3e5d111becf1 1073741824 Sep 04 16:04:04 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08ddb0c-1a72-416b-9cf9-229bc94252e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:04 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Volume volume-53533872-86e0-40a5-bdab-734fa88433b7 (53533872-86e0-40a5-bdab-734fa88433b7): created successfully Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08ddb0c-1a72-416b-9cf9-229bc94252e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Flow 'volume_create_manager' (62884c41-49ec-4bda-bb89-06a669035f70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:04 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-80d2e831-6d73-4bc3-9926-277f596718ee tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Created volume successfully. Sep 04 16:04:04 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-de7e2434-3296-4247-a24b-3e5d111becf1 1073741824" returned: 0 in 0.478s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-de7e2434-3296-4247-a24b-3e5d111becf1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:04 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-de7e2434-3296-4247-a24b-3e5d111becf1 Sep 04 16:04:04 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:04 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-de7e2434-3296-4247-a24b-3e5d111becf1" returned: 0 in 0.267s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.902s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1092272362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0c464a-983c-439c-b5bb-ab352d5410ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c477b230ddf441ea66fed24aeed2276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:03Z,use_quota=True,user_id='439d1f9dc06f4ba8b238b44e1561089e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Creating volume ef0c464a-983c-439c-b5bb-ab352d5410ac {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:04:04 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef0c464a-983c-439c-b5bb-ab352d5410ac 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:04 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef0c464a-983c-439c-b5bb-ab352d5410ac 1073741824 Sep 04 16:04:04 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acf0e25-77c1-4afe-98d8-d05d63cedede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de7e2434-3296-4247-a24b-3e5d111becf1', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d89b527-c25b-4087-a8f7-518c3c8e5639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:04 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Volume volume-de7e2434-3296-4247-a24b-3e5d111becf1 (de7e2434-3296-4247-a24b-3e5d111becf1): created successfully Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d89b527-c25b-4087-a8f7-518c3c8e5639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Flow 'volume_create_manager' (673bfacf-ce91-4036-8b74-5eb8de67a609) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:04 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-99a7c74d-13d6-4382-a21a-3c1da582cd5c tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Created volume successfully. Sep 04 16:04:05 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef0c464a-983c-439c-b5bb-ab352d5410ac 1073741824" returned: 0 in 0.543s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef0c464a-983c-439c-b5bb-ab352d5410ac {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:05 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef0c464a-983c-439c-b5bb-ab352d5410ac Sep 04 16:04:05 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:05 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef0c464a-983c-439c-b5bb-ab352d5410ac" returned: 0 in 0.299s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:04:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522e6100-2d90-4ac1-a2d9-3f2f799a186d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef0c464a-983c-439c-b5bb-ab352d5410ac', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9af89ff-232d-44bb-8f74-683619617bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:05 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Volume volume-ef0c464a-983c-439c-b5bb-ab352d5410ac (ef0c464a-983c-439c-b5bb-ab352d5410ac): created successfully Sep 04 16:04:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9af89ff-232d-44bb-8f74-683619617bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:05 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Flow 'volume_create_manager' (c66b10b6-4db5-4d53-8f5e-dfe8604b8a00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:05 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-6c5a2f46-299d-4775-8a1b-e1fe7ef0f3be tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Created volume successfully. Sep 04 16:04:06 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-79312bbf-c994-4b06-b1a7-ec341c8d5220 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "cinder-ef0c464a-983c-439c-b5bb-ab352d5410ac-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:06 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-79312bbf-c994-4b06-b1a7-ec341c8d5220 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-ef0c464a-983c-439c-b5bb-ab352d5410ac-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:06 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-79312bbf-c994-4b06-b1a7-ec341c8d5220 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "cinder-quobyte-ef0c464a-983c-439c-b5bb-ab352d5410ac" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:06 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-79312bbf-c994-4b06-b1a7-ec341c8d5220 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-quobyte-ef0c464a-983c-439c-b5bb-ab352d5410ac" acquired by "delete_volume" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:06 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[777dd1be-5c04-4438-97ee-f795c7907c71]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79312bbf-c994-4b06-b1a7-ec341c8d5220 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef0c464a-983c-439c-b5bb-ab352d5410ac {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:06 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef0c464a-983c-439c-b5bb-ab352d5410ac Sep 04 16:04:06 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:06 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79312bbf-c994-4b06-b1a7-ec341c8d5220 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef0c464a-983c-439c-b5bb-ab352d5410ac" returned: 0 in 0.384s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79312bbf-c994-4b06-b1a7-ec341c8d5220 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef0c464a-983c-439c-b5bb-ab352d5410ac {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:06 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef0c464a-983c-439c-b5bb-ab352d5410ac Sep 04 16:04:06 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:06 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79312bbf-c994-4b06-b1a7-ec341c8d5220 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef0c464a-983c-439c-b5bb-ab352d5410ac" returned: 0 in 0.272s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-79312bbf-c994-4b06-b1a7-ec341c8d5220 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-quobyte-ef0c464a-983c-439c-b5bb-ab352d5410ac" released by "delete_volume" :: held 0.700s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:07 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-79312bbf-c994-4b06-b1a7-ec341c8d5220 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Created reservations ['a024077c-7eef-4bf0-bbde-24f343f67cce', 'c49bdb6d-a200-428b-b4ae-d502f36466d9', '7e090304-e415-4676-8bd9-603520d346fb', '77393bd6-a3da-421b-b5a1-1adbe0c4a6cb'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-79312bbf-c994-4b06-b1a7-ec341c8d5220 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-79312bbf-c994-4b06-b1a7-ec341c8d5220 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-79312bbf-c994-4b06-b1a7-ec341c8d5220 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:04:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-79312bbf-c994-4b06-b1a7-ec341c8d5220 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:04:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-79312bbf-c994-4b06-b1a7-ec341c8d5220 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79312bbf-c994-4b06-b1a7-ec341c8d5220 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:07 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:04:07 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bd184585-4a89-447c-b3ea-db25846c44b9 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "cinder-de7e2434-3296-4247-a24b-3e5d111becf1-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bd184585-4a89-447c-b3ea-db25846c44b9 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-de7e2434-3296-4247-a24b-3e5d111becf1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:07 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79312bbf-c994-4b06-b1a7-ec341c8d5220 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.382s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:07 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-79312bbf-c994-4b06-b1a7-ec341c8d5220 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:07 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-79312bbf-c994-4b06-b1a7-ec341c8d5220 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Deleted volume successfully. Sep 04 16:04:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bd184585-4a89-447c-b3ea-db25846c44b9 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "cinder-quobyte-de7e2434-3296-4247-a24b-3e5d111becf1" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-79312bbf-c994-4b06-b1a7-ec341c8d5220 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-ef0c464a-983c-439c-b5bb-ab352d5410ac-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bd184585-4a89-447c-b3ea-db25846c44b9 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-quobyte-de7e2434-3296-4247-a24b-3e5d111becf1" acquired by "delete_volume" :: waited 0.039s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:07 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[03eeaa09-ee89-4e5c-83d9-ca92abda34a3]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd184585-4a89-447c-b3ea-db25846c44b9 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-de7e2434-3296-4247-a24b-3e5d111becf1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:07 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-de7e2434-3296-4247-a24b-3e5d111becf1 Sep 04 16:04:07 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:08 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd184585-4a89-447c-b3ea-db25846c44b9 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-de7e2434-3296-4247-a24b-3e5d111becf1" returned: 0 in 0.570s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd184585-4a89-447c-b3ea-db25846c44b9 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-de7e2434-3296-4247-a24b-3e5d111becf1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:08 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-de7e2434-3296-4247-a24b-3e5d111becf1 Sep 04 16:04:08 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:08 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd184585-4a89-447c-b3ea-db25846c44b9 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-de7e2434-3296-4247-a24b-3e5d111becf1" returned: 0 in 0.363s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bd184585-4a89-447c-b3ea-db25846c44b9 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-quobyte-de7e2434-3296-4247-a24b-3e5d111becf1" released by "delete_volume" :: held 0.997s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:08 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-bd184585-4a89-447c-b3ea-db25846c44b9 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Created reservations ['31b8431f-f971-4b17-8641-8fb2578e8d35', 'e89dece5-9687-4931-8118-f5360c9fd94d', '5c1d3b5d-5ced-41de-a1aa-2cf8f1a3130c', '74f48826-0549-4bd6-a324-c1fd2487571e'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bd184585-4a89-447c-b3ea-db25846c44b9 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bd184585-4a89-447c-b3ea-db25846c44b9 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bd184585-4a89-447c-b3ea-db25846c44b9 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:04:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bd184585-4a89-447c-b3ea-db25846c44b9 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:04:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bd184585-4a89-447c-b3ea-db25846c44b9 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd184585-4a89-447c-b3ea-db25846c44b9 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:08 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:04:08 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:09 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd184585-4a89-447c-b3ea-db25846c44b9 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.263s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:09 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bd184585-4a89-447c-b3ea-db25846c44b9 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:09 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-bd184585-4a89-447c-b3ea-db25846c44b9 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Deleted volume successfully. Sep 04 16:04:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bd184585-4a89-447c-b3ea-db25846c44b9 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-de7e2434-3296-4247-a24b-3e5d111becf1-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8522ab96-6e8a-4309-9ed0-e09ed08e37f8 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "cinder-53533872-86e0-40a5-bdab-734fa88433b7-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8522ab96-6e8a-4309-9ed0-e09ed08e37f8 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-53533872-86e0-40a5-bdab-734fa88433b7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8522ab96-6e8a-4309-9ed0-e09ed08e37f8 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "cinder-quobyte-53533872-86e0-40a5-bdab-734fa88433b7" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8522ab96-6e8a-4309-9ed0-e09ed08e37f8 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-quobyte-53533872-86e0-40a5-bdab-734fa88433b7" acquired by "delete_volume" :: waited 0.023s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:09 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8632b4-a9c2-4eb4-897e-d2f8ee1cfc53]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8522ab96-6e8a-4309-9ed0-e09ed08e37f8 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-53533872-86e0-40a5-bdab-734fa88433b7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:10 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-53533872-86e0-40a5-bdab-734fa88433b7 Sep 04 16:04:10 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:10 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8522ab96-6e8a-4309-9ed0-e09ed08e37f8 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-53533872-86e0-40a5-bdab-734fa88433b7" returned: 0 in 0.412s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8522ab96-6e8a-4309-9ed0-e09ed08e37f8 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-53533872-86e0-40a5-bdab-734fa88433b7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:10 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-53533872-86e0-40a5-bdab-734fa88433b7 Sep 04 16:04:10 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:10 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8522ab96-6e8a-4309-9ed0-e09ed08e37f8 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-53533872-86e0-40a5-bdab-734fa88433b7" returned: 0 in 0.295s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:10 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8522ab96-6e8a-4309-9ed0-e09ed08e37f8 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-quobyte-53533872-86e0-40a5-bdab-734fa88433b7" released by "delete_volume" :: held 0.766s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:10 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-8522ab96-6e8a-4309-9ed0-e09ed08e37f8 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Created reservations ['b0b09617-976f-4efb-82d7-ea7138376fbe', 'd2c18454-78ab-4287-beaf-e67600d6a912', 'cb8447eb-89ed-44e1-99c3-72f1cbea96ea', '4223ed35-67ba-4f6e-a943-e76abaeb2c8c'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8522ab96-6e8a-4309-9ed0-e09ed08e37f8 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8522ab96-6e8a-4309-9ed0-e09ed08e37f8 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8522ab96-6e8a-4309-9ed0-e09ed08e37f8 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:04:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8522ab96-6e8a-4309-9ed0-e09ed08e37f8 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:04:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8522ab96-6e8a-4309-9ed0-e09ed08e37f8 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8522ab96-6e8a-4309-9ed0-e09ed08e37f8 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:10 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:04:10 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:11 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-516d557e-3a4e-4933-a24d-ba6ed288c1a4 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "cinder-bfb531bf-6059-40fa-931b-9022306b88fa-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:11 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-516d557e-3a4e-4933-a24d-ba6ed288c1a4 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-bfb531bf-6059-40fa-931b-9022306b88fa-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:11 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-516d557e-3a4e-4933-a24d-ba6ed288c1a4 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "cinder-quobyte-bfb531bf-6059-40fa-931b-9022306b88fa" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:11 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-516d557e-3a4e-4933-a24d-ba6ed288c1a4 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-quobyte-bfb531bf-6059-40fa-931b-9022306b88fa" acquired by "delete_volume" :: waited 0.030s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:11 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f5e24f-8086-4f74-ba01-89d30b73993c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-516d557e-3a4e-4933-a24d-ba6ed288c1a4 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bfb531bf-6059-40fa-931b-9022306b88fa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:11 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8522ab96-6e8a-4309-9ed0-e09ed08e37f8 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.440s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:11 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-8522ab96-6e8a-4309-9ed0-e09ed08e37f8 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:11 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-8522ab96-6e8a-4309-9ed0-e09ed08e37f8 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Deleted volume successfully. Sep 04 16:04:11 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8522ab96-6e8a-4309-9ed0-e09ed08e37f8 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-53533872-86e0-40a5-bdab-734fa88433b7-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:11 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bfb531bf-6059-40fa-931b-9022306b88fa Sep 04 16:04:11 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:11 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-516d557e-3a4e-4933-a24d-ba6ed288c1a4 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bfb531bf-6059-40fa-931b-9022306b88fa" returned: 0 in 0.421s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-516d557e-3a4e-4933-a24d-ba6ed288c1a4 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bfb531bf-6059-40fa-931b-9022306b88fa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:11 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bfb531bf-6059-40fa-931b-9022306b88fa Sep 04 16:04:11 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:12 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-516d557e-3a4e-4933-a24d-ba6ed288c1a4 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bfb531bf-6059-40fa-931b-9022306b88fa" returned: 0 in 0.285s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-516d557e-3a4e-4933-a24d-ba6ed288c1a4 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-quobyte-bfb531bf-6059-40fa-931b-9022306b88fa" released by "delete_volume" :: held 0.787s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:12 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-516d557e-3a4e-4933-a24d-ba6ed288c1a4 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Created reservations ['814ab077-6e1c-442f-975e-54184e1bc723', '087467cd-b163-49af-965b-0e0758032892', 'd20e19d0-a018-459d-8e30-431bd69fad13', '81c9b75c-759b-4278-ac40-9c3019d0fd80'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-516d557e-3a4e-4933-a24d-ba6ed288c1a4 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-516d557e-3a4e-4933-a24d-ba6ed288c1a4 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-516d557e-3a4e-4933-a24d-ba6ed288c1a4 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:04:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-516d557e-3a4e-4933-a24d-ba6ed288c1a4 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:04:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-516d557e-3a4e-4933-a24d-ba6ed288c1a4 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-516d557e-3a4e-4933-a24d-ba6ed288c1a4 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:12 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:04:12 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3579aa54-de4c-4541-af04-fa177a304b41 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "cinder-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3579aa54-de4c-4541-af04-fa177a304b41 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3579aa54-de4c-4541-af04-fa177a304b41 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "cinder-quobyte-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3579aa54-de4c-4541-af04-fa177a304b41 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-quobyte-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2" acquired by "delete_volume" :: waited 0.034s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:12 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec8a6e7-0141-4c35-9807-1e726dd05aed]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3579aa54-de4c-4541-af04-fa177a304b41 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:12 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-516d557e-3a4e-4933-a24d-ba6ed288c1a4 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.280s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:12 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-516d557e-3a4e-4933-a24d-ba6ed288c1a4 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:12 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-516d557e-3a4e-4933-a24d-ba6ed288c1a4 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Deleted volume successfully. Sep 04 16:04:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-516d557e-3a4e-4933-a24d-ba6ed288c1a4 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-bfb531bf-6059-40fa-931b-9022306b88fa-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:12 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2 Sep 04 16:04:12 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:12 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3579aa54-de4c-4541-af04-fa177a304b41 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2" returned: 0 in 0.377s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3579aa54-de4c-4541-af04-fa177a304b41 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:12 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2 Sep 04 16:04:12 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:13 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3579aa54-de4c-4541-af04-fa177a304b41 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2" returned: 0 in 0.244s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3579aa54-de4c-4541-af04-fa177a304b41 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-quobyte-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2" released by "delete_volume" :: held 0.663s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:13 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-3579aa54-de4c-4541-af04-fa177a304b41 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Created reservations ['339c5592-e913-4ab7-9f8b-0ca0029841ef', '805cb678-63ed-4e8a-b3ad-029dab42266d', 'd4d287e9-60fc-4f38-b110-3d333cb5392f', 'fbd4dcce-ae82-4f5a-97ca-b31e09e20dca'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3579aa54-de4c-4541-af04-fa177a304b41 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3579aa54-de4c-4541-af04-fa177a304b41 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3579aa54-de4c-4541-af04-fa177a304b41 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:04:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3579aa54-de4c-4541-af04-fa177a304b41 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:04:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3579aa54-de4c-4541-af04-fa177a304b41 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3579aa54-de4c-4541-af04-fa177a304b41 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:13 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:04:13 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:13 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3579aa54-de4c-4541-af04-fa177a304b41 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.249s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:13 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-3579aa54-de4c-4541-af04-fa177a304b41 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:13 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-3579aa54-de4c-4541-af04-fa177a304b41 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Deleted volume successfully. Sep 04 16:04:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3579aa54-de4c-4541-af04-fa177a304b41 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-ef1b54ed-a2e8-4ac1-a980-bb463e59c1b2-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9d297042-a339-4651-be89-c48380643a70 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "cinder-b54c94ef-38d3-454b-943c-5614b1260841-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9d297042-a339-4651-be89-c48380643a70 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-b54c94ef-38d3-454b-943c-5614b1260841-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9d297042-a339-4651-be89-c48380643a70 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "cinder-quobyte-b54c94ef-38d3-454b-943c-5614b1260841" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9d297042-a339-4651-be89-c48380643a70 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-quobyte-b54c94ef-38d3-454b-943c-5614b1260841" acquired by "delete_volume" :: waited 0.014s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:13 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[5121a48b-74ef-4e9f-8077-3fb4d2061638]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9d297042-a339-4651-be89-c48380643a70 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b54c94ef-38d3-454b-943c-5614b1260841 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:13 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b54c94ef-38d3-454b-943c-5614b1260841 Sep 04 16:04:13 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:14 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9d297042-a339-4651-be89-c48380643a70 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b54c94ef-38d3-454b-943c-5614b1260841" returned: 0 in 0.368s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9d297042-a339-4651-be89-c48380643a70 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b54c94ef-38d3-454b-943c-5614b1260841 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:14 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b54c94ef-38d3-454b-943c-5614b1260841 Sep 04 16:04:14 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:14 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9d297042-a339-4651-be89-c48380643a70 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b54c94ef-38d3-454b-943c-5614b1260841" returned: 0 in 0.233s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9d297042-a339-4651-be89-c48380643a70 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-quobyte-b54c94ef-38d3-454b-943c-5614b1260841" released by "delete_volume" :: held 0.643s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:14 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-9d297042-a339-4651-be89-c48380643a70 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Created reservations ['bde86d90-4b3e-483e-a490-ed3e14262017', '8a5034f9-f56c-4e09-9a95-44491acfdb8b', '1c4d83c2-710d-41ad-a859-b854d84756d1', '8d6416b9-14f1-4f34-a144-25113691beea'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9d297042-a339-4651-be89-c48380643a70 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9d297042-a339-4651-be89-c48380643a70 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9d297042-a339-4651-be89-c48380643a70 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:04:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9d297042-a339-4651-be89-c48380643a70 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:04:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9d297042-a339-4651-be89-c48380643a70 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9d297042-a339-4651-be89-c48380643a70 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:14 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:04:14 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:14 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9d297042-a339-4651-be89-c48380643a70 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.252s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:14 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-9d297042-a339-4651-be89-c48380643a70 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:14 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-9d297042-a339-4651-be89-c48380643a70 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Deleted volume successfully. Sep 04 16:04:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9d297042-a339-4651-be89-c48380643a70 tempest-CreateVolumesFromSourceVolumeTest-1754184094 None] Lock "cinder-b54c94ef-38d3-454b-943c-5614b1260841-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:19 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:04:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Flow 'volume_create_manager' (4411f85b-4b83-4931-81a3-76397c90862f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f5b378-1896-4c24-b0fd-40192fbe64be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f5b378-1896-4c24-b0fd-40192fbe64be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a25f5ba2-da1d-457d-a73b-7c228b8b47d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9417c4504d664907819874f0772e102b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:20Z,use_quota=True,user_id='a55b0a97a4644699863319c69b36903e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b7455b4-efa7-4572-9614-2e8623d5d82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b7455b4-efa7-4572-9614-2e8623d5d82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc4ab1f-932e-47e1-b459-5897a7629b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:19 devstack cinder-volume[87513]: DEBUG cinder.image.glance [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Creating Keystone auth plugin from conf {{(pid=87513) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 16:04:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc4ab1f-932e-47e1-b459-5897a7629b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a25f5ba2-da1d-457d-a73b-7c228b8b47d2', 'volume_name': 'volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2', 'volume_size': 1, 'image_id': '423490b7-94c0-4835-b27f-468443443ca2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/423490b7-94c0-4835-b27f-468443443ca2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4eadf16a31e652a91588d79de86ffc01', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9417c4504d664907819874f0772e102b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9b46db77051a18b91550a9934b939675b3292d5a5663a3ee2443b2825a1e25ed8402bf52a043c0988330ff0591c6f9aa5510ebcc670749665ce0f10dbccf9362', 'id': '423490b7-94c0-4835-b27f-468443443ca2', 'created_at': datetime.datetime(2026, 9, 4, 14, 4, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 4, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/423490b7-94c0-4835-b27f-468443443ca2/file', 'properties': {}}, 'image_service': }' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7889416f-eacd-4a0a-8ac7-370eab8e33c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7889416f-eacd-4a0a-8ac7-370eab8e33c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc4e2ac-a499-402c-8761-21ce247a2037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:20 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Volume a25f5ba2-da1d-457d-a73b-7c228b8b47d2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2', 'volume_size': 1, 'image_id': '423490b7-94c0-4835-b27f-468443443ca2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/423490b7-94c0-4835-b27f-468443443ca2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4eadf16a31e652a91588d79de86ffc01', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9417c4504d664907819874f0772e102b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9b46db77051a18b91550a9934b939675b3292d5a5663a3ee2443b2825a1e25ed8402bf52a043c0988330ff0591c6f9aa5510ebcc670749665ce0f10dbccf9362', 'id': '423490b7-94c0-4835-b27f-468443443ca2', 'created_at': datetime.datetime(2026, 9, 4, 14, 4, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 4, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/423490b7-94c0-4835-b27f-468443443ca2/file', 'properties': {}}, 'image_service': } Sep 04 16:04:20 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Trying to clone a25f5ba2-da1d-457d-a73b-7c228b8b47d2 from image 423490b7-94c0-4835-b27f-468443443ca2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/423490b7-94c0-4835-b27f-468443443ca2', 'metadata': {}}]). {{(pid=87513) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 16:04:20 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 16:04:20 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Image download 0.00 MB at 0.00 MB/s Sep 04 16:04:20 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2decf4b-148b-419a-b930-fca9db4bc8e9]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:20 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD Sep 04 16:04:20 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:20 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:20 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD Sep 04 16:04:20 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:20 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:04:20 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Temporary image 423490b7-94c0-4835-b27f-468443443ca2 is fetched for user a55b0a97a4644699863319c69b36903e. {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 16:04:21 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec7e56b-0cf3-4506-8e78-8699b206a51d]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:21 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD Sep 04 16:04:21 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:21 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:21 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD Sep 04 16:04:21 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:21 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:04:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:21 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a25f5ba2-da1d-457d-a73b-7c228b8b47d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9417c4504d664907819874f0772e102b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:20Z,use_quota=True,user_id='a55b0a97a4644699863319c69b36903e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:04:21 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Creating volume a25f5ba2-da1d-457d-a73b-7c228b8b47d2 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:04:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:21 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:04:21 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:04:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:21 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:04:21 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:04:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:21 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 1073741824 Sep 04 16:04:21 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:22 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 1073741824" returned: 0 in 0.411s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:22 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 Sep 04 16:04:22 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:22 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2" returned: 0 in 0.259s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:04:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:22 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Attempting download of 423490b7-94c0-4835-b27f-468443443ca2 ((None, [{'url': 'file:///opt/stack/data/glance/images/423490b7-94c0-4835-b27f-468443443ca2', 'metadata': {}}])) to volume a25f5ba2-da1d-457d-a73b-7c228b8b47d2. {{(pid=87513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 16:04:22 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[363df141-6111-4b0d-9ec6-4ea8370e4fe9]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_423490b7-94c0-4835-b27f-468443443ca2_udfbefc6 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:22 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_423490b7-94c0-4835-b27f-468443443ca2_udfbefc6 Sep 04 16:04:22 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:22 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_423490b7-94c0-4835-b27f-468443443ca2_udfbefc6" returned: 0 in 0.334s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423490b7-94c0-4835-b27f-468443443ca2_udfbefc6 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:22 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423490b7-94c0-4835-b27f-468443443ca2_udfbefc6 Sep 04 16:04:22 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:23 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423490b7-94c0-4835-b27f-468443443ca2_udfbefc6" returned: 1 in 0.331s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423490b7-94c0-4835-b27f-468443443ca2_udfbefc6' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:04:23 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[22804363-4123-4820-864f-74b1c7f90044]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:23 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD Sep 04 16:04:23 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:23 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:23 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD Sep 04 16:04:23 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:23 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD" returned: 1 in 0.327s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:04:23 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] 423490b7-94c0-4835-b27f-468443443ca2 was raw, converting to raw {{(pid=87513) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 16:04:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:23 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 Sep 04 16:04:23 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:24 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2" returned: 0 in 0.318s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:24 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_423490b7-94c0-4835-b27f-468443443ca2_axgl7cawdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:04:24 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 16:04:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:24 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 1G Sep 04 16:04:24 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:24 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 1G" returned: 0 in 0.278s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:24 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9710c02-f664-4308-92c2-211c7721315c]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:24 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 Sep 04 16:04:24 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:24 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2" returned: 0 in 0.357s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:24 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 Sep 04 16:04:24 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:25 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2" returned: 1 in 0.330s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:04:25 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Downloaded image 423490b7-94c0-4835-b27f-468443443ca2 ((None, [{'url': 'file:///opt/stack/data/glance/images/423490b7-94c0-4835-b27f-468443443ca2', 'metadata': {}}])) to volume a25f5ba2-da1d-457d-a73b-7c228b8b47d2 successfully. {{(pid=87513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 16:04:25 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Temporary image 423490b7-94c0-4835-b27f-468443443ca2 for user a55b0a97a4644699863319c69b36903e is deleted. {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 16:04:25 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Marking volume a25f5ba2-da1d-457d-a73b-7c228b8b47d2 as bootable. {{(pid=87513) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 16:04:25 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Copying metadata from image 423490b7-94c0-4835-b27f-468443443ca2 to a25f5ba2-da1d-457d-a73b-7c228b8b47d2. {{(pid=87513) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 16:04:25 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Creating volume glance metadata for volume a25f5ba2-da1d-457d-a73b-7c228b8b47d2 backed by image 423490b7-94c0-4835-b27f-468443443ca2 with: {'image_id': '423490b7-94c0-4835-b27f-468443443ca2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4eadf16a31e652a91588d79de86ffc01', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87513) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 16:04:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc4e2ac-a499-402c-8761-21ce247a2037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2', 'volume_size': 1, 'image_id': '423490b7-94c0-4835-b27f-468443443ca2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/423490b7-94c0-4835-b27f-468443443ca2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4eadf16a31e652a91588d79de86ffc01', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9417c4504d664907819874f0772e102b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9b46db77051a18b91550a9934b939675b3292d5a5663a3ee2443b2825a1e25ed8402bf52a043c0988330ff0591c6f9aa5510ebcc670749665ce0f10dbccf9362', 'id': '423490b7-94c0-4835-b27f-468443443ca2', 'created_at': datetime.datetime(2026, 9, 4, 14, 4, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 4, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/423490b7-94c0-4835-b27f-468443443ca2/file', 'properties': {}}, 'image_service': }' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab979990-210f-4d5a-a306-a55c93f257bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:25 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Volume volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 (a25f5ba2-da1d-457d-a73b-7c228b8b47d2): created successfully Sep 04 16:04:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab979990-210f-4d5a-a306-a55c93f257bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Flow 'volume_create_manager' (4411f85b-4b83-4931-81a3-76397c90862f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:25 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-61022809-96a1-405d-890e-79d46f07fe27 tempest-VolumeImageDependencyTests-1136197320 None] Created volume successfully. Sep 04 16:04:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] Acquiring lock "cinder-a25f5ba2-da1d-457d-a73b-7c228b8b47d2-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] Lock "cinder-a25f5ba2-da1d-457d-a73b-7c228b8b47d2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] Acquiring lock "cinder-quobyte-a25f5ba2-da1d-457d-a73b-7c228b8b47d2" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] Lock "cinder-quobyte-a25f5ba2-da1d-457d-a73b-7c228b8b47d2" acquired by "delete_volume" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:26 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0f088e-a9bd-4aab-af67-dab983a69317]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:26 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 Sep 04 16:04:26 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:26 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2" returned: 0 in 0.347s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:26 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 Sep 04 16:04:26 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:26 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2" returned: 1 in 0.340s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:04:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:26 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2 Sep 04 16:04:26 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:27 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a25f5ba2-da1d-457d-a73b-7c228b8b47d2" returned: 0 in 0.247s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] Lock "cinder-quobyte-a25f5ba2-da1d-457d-a73b-7c228b8b47d2" released by "delete_volume" :: held 0.991s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:27 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] Created reservations ['e614f854-f31d-4ff8-934d-dd6fed833165', 'f3d62979-39d2-4141-a766-b161abf101fe', '9dcbacb1-28b1-41e4-8546-09058f6d561b', '7edb3736-20cf-470e-b64c-9b70e7bc4a8b'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:27 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:04:27 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:04:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:27 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:04:27 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:27 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.246s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:27 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:27 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] Deleted volume successfully. Sep 04 16:04:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8dec9a29-652a-4b4e-9210-a0c36fcec534 tempest-VolumeImageDependencyTests-1136197320 None] Lock "cinder-a25f5ba2-da1d-457d-a73b-7c228b8b47d2-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Flow 'volume_create_manager' (bf64fe03-d123-49f5-81cd-2f26bd533187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e1156c-d64f-45f9-a7e5-48cb245c8a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e1156c-d64f-45f9-a7e5-48cb245c8a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb4d9fe-3143-4278-8dca-bb5ab70fa07b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5334911a64c544e69dc0ad3e8488456b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:32Z,use_quota=True,user_id='144229caaa7f4d46afbdb32f9c479bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8758c902-873c-4243-a239-468b5b18c9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8758c902-873c-4243-a239-468b5b18c9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291167e3-9b33-46fa-a75e-d553757d8083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291167e3-9b33-46fa-a75e-d553757d8083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccb4d9fe-3143-4278-8dca-bb5ab70fa07b', 'volume_name': 'volume-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f40a755-e9b5-4e29-b9b8-cec1f228a1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f40a755-e9b5-4e29-b9b8-cec1f228a1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3beb10d7-02e0-4b77-acb3-6e7767e734b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:31 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Volume ccb4d9fe-3143-4278-8dca-bb5ab70fa07b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b', 'volume_size': 1} Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb4d9fe-3143-4278-8dca-bb5ab70fa07b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5334911a64c544e69dc0ad3e8488456b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:32Z,use_quota=True,user_id='144229caaa7f4d46afbdb32f9c479bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Creating volume ccb4d9fe-3143-4278-8dca-bb5ab70fa07b {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:04:31 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:04:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:31 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b 1073741824 Sep 04 16:04:31 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:32 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b 1073741824" returned: 0 in 0.505s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Flow 'volume_create_manager' (bbd62d80-536b-4d45-b435-75fdffcb984b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff81bda1-881f-4123-9ff8-8767cba5665a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff81bda1-881f-4123-9ff8-8767cba5665a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1301414574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8feddd7d-31be-4980-bc91-23b860d8ea7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e596e450a824038bdd7d14ba7c0a4c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:32Z,use_quota=True,user_id='43f7cd38bdd2406cbfa66d614ed61a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ddf677-1b5c-468e-9645-a95ead48e3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ddf677-1b5c-468e-9645-a95ead48e3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5bebb0-c8d5-4dba-aaae-542ac2abce9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5bebb0-c8d5-4dba-aaae-542ac2abce9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8feddd7d-31be-4980-bc91-23b860d8ea7e', 'volume_name': 'volume-8feddd7d-31be-4980-bc91-23b860d8ea7e', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52013f53-b13b-42b1-8626-da87e879342a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52013f53-b13b-42b1-8626-da87e879342a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4ffd32-4245-4542-a9be-5b1b69317312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:32 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Volume 8feddd7d-31be-4980-bc91-23b860d8ea7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8feddd7d-31be-4980-bc91-23b860d8ea7e', 'volume_size': 1} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:32 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b Sep 04 16:04:32 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:32 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b" returned: 0 in 0.246s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.255s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1301414574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8feddd7d-31be-4980-bc91-23b860d8ea7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e596e450a824038bdd7d14ba7c0a4c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:32Z,use_quota=True,user_id='43f7cd38bdd2406cbfa66d614ed61a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Creating volume 8feddd7d-31be-4980-bc91-23b860d8ea7e {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:04:32 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8feddd7d-31be-4980-bc91-23b860d8ea7e 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:32 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8feddd7d-31be-4980-bc91-23b860d8ea7e 1073741824 Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3beb10d7-02e0-4b77-acb3-6e7767e734b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:32 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763fb561-8e9b-45b7-889e-04613db079a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:32 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Volume volume-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b (ccb4d9fe-3143-4278-8dca-bb5ab70fa07b): created successfully Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763fb561-8e9b-45b7-889e-04613db079a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:32 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Flow 'volume_create_manager' (bf64fe03-d123-49f5-81cd-2f26bd533187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:32 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-8ec98610-0a9f-4df5-b000-78098fb2fb83 tempest-CinderUnicodeTest-652145621 None] Created volume successfully. Sep 04 16:04:33 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8feddd7d-31be-4980-bc91-23b860d8ea7e 1073741824" returned: 0 in 0.471s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8feddd7d-31be-4980-bc91-23b860d8ea7e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:33 devstack sudo[102884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8feddd7d-31be-4980-bc91-23b860d8ea7e Sep 04 16:04:33 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:33 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8feddd7d-31be-4980-bc91-23b860d8ea7e" returned: 0 in 0.285s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:04:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4ffd32-4245-4542-a9be-5b1b69317312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8feddd7d-31be-4980-bc91-23b860d8ea7e', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55474cba-39be-4b76-ab2c-50537bc12142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:33 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Volume volume-8feddd7d-31be-4980-bc91-23b860d8ea7e (8feddd7d-31be-4980-bc91-23b860d8ea7e): created successfully Sep 04 16:04:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55474cba-39be-4b76-ab2c-50537bc12142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Flow 'volume_create_manager' (bbd62d80-536b-4d45-b435-75fdffcb984b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:33 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-a43ec295-c737-4ad2-95ef-f0a41c892994 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Created volume successfully. Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Flow 'volume_create_manager' (ba8671da-419e-49a1-a7af-92e144c664a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0571b517-fa07-4ac2-8b5f-71240c172d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0571b517-fa07-4ac2-8b5f-71240c172d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1972387784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b4f45c-a9ce-4728-840e-0810a872b739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5334911a64c544e69dc0ad3e8488456b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:34Z,use_quota=True,user_id='144229caaa7f4d46afbdb32f9c479bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4833985b-23ee-4687-a9ec-6132f16c3e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4833985b-23ee-4687-a9ec-6132f16c3e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726ad657-3bc6-46c1-9deb-b04aed12d8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726ad657-3bc6-46c1-9deb-b04aed12d8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2b4f45c-a9ce-4728-840e-0810a872b739', 'volume_name': 'volume-c2b4f45c-a9ce-4728-840e-0810a872b739', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5761008-0b8b-437f-b6bb-572f228045cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5761008-0b8b-437f-b6bb-572f228045cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fa1ef4-8467-4f21-ba15-705614dda429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:34 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Volume c2b4f45c-a9ce-4728-840e-0810a872b739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2b4f45c-a9ce-4728-840e-0810a872b739', 'volume_size': 1} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1972387784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b4f45c-a9ce-4728-840e-0810a872b739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5334911a64c544e69dc0ad3e8488456b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:34Z,use_quota=True,user_id='144229caaa7f4d46afbdb32f9c479bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Creating volume c2b4f45c-a9ce-4728-840e-0810a872b739 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:04:34 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:34 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739 1073741824 Sep 04 16:04:34 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:34 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739 1073741824" returned: 0 in 0.467s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:34 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739 Sep 04 16:04:34 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:34 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:04:34 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:35 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739" returned: 0 in 0.276s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:04:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fa1ef4-8467-4f21-ba15-705614dda429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2b4f45c-a9ce-4728-840e-0810a872b739', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57a7c1e-a4ed-4972-a168-f20d287439d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:35 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Volume volume-c2b4f45c-a9ce-4728-840e-0810a872b739 (c2b4f45c-a9ce-4728-840e-0810a872b739): created successfully Sep 04 16:04:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57a7c1e-a4ed-4972-a168-f20d287439d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Flow 'volume_create_manager' (ba8671da-419e-49a1-a7af-92e144c664a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:35 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-1416defa-8eaf-4646-bdbb-fc2fe5d73a39 tempest-CinderUnicodeTest-652145621 None] Created volume successfully. Sep 04 16:04:35 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.319s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:04:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 28 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:04:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 16:04:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-edf7269b-5f2c-4996-bce1-986d24380b80 req-f923b372-dd89-4e45-abd2-1aa0e0605080 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-edf7269b-5f2c-4996-bce1-986d24380b80 req-f923b372-dd89-4e45-abd2-1aa0e0605080 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:35 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a101b5db-5ace-4df5-b671-384a37418d8c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-edf7269b-5f2c-4996-bce1-986d24380b80 req-f923b372-dd89-4e45-abd2-1aa0e0605080 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8feddd7d-31be-4980-bc91-23b860d8ea7e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:35 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8feddd7d-31be-4980-bc91-23b860d8ea7e Sep 04 16:04:35 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:35 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-edf7269b-5f2c-4996-bce1-986d24380b80 req-f923b372-dd89-4e45-abd2-1aa0e0605080 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8feddd7d-31be-4980-bc91-23b860d8ea7e" returned: 0 in 0.352s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-edf7269b-5f2c-4996-bce1-986d24380b80 req-f923b372-dd89-4e45-abd2-1aa0e0605080 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.367s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-edf7269b-5f2c-4996-bce1-986d24380b80 req-f923b372-dd89-4e45-abd2-1aa0e0605080 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-8feddd7d-31be-4980-bc91-23b860d8ea7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '203dfb04-f2bb-400c-830c-75a7c6a099df', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 16:04:35 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-edf7269b-5f2c-4996-bce1-986d24380b80 req-f923b372-dd89-4e45-abd2-1aa0e0605080 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] attachment_update completed successfully. Sep 04 16:04:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fba6f6ad-24d8-41c8-9c86-74eae4239356 tempest-CinderUnicodeTest-652145621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fba6f6ad-24d8-41c8-9c86-74eae4239356 tempest-CinderUnicodeTest-652145621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:36 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-fba6f6ad-24d8-41c8-9c86-74eae4239356 tempest-CinderUnicodeTest-652145621 None] Creating offline snapshot 2c358ac4-8cc8-4f9e-a836-8582705935c7 of volume c2b4f45c-a9ce-4728-840e-0810a872b739 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:04:36 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[667cdf3a-4a2c-48e3-b863-c1c677089d93]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fba6f6ad-24d8-41c8-9c86-74eae4239356 tempest-CinderUnicodeTest-652145621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:36 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739 Sep 04 16:04:36 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:36 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fba6f6ad-24d8-41c8-9c86-74eae4239356 tempest-CinderUnicodeTest-652145621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739" returned: 0 in 0.335s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fba6f6ad-24d8-41c8-9c86-74eae4239356 tempest-CinderUnicodeTest-652145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.2c358ac4-8cc8-4f9e-a836-8582705935c7 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:36 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.2c358ac4-8cc8-4f9e-a836-8582705935c7 1G Sep 04 16:04:36 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:37 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fba6f6ad-24d8-41c8-9c86-74eae4239356 tempest-CinderUnicodeTest-652145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.2c358ac4-8cc8-4f9e-a836-8582705935c7 1G" returned: 0 in 0.392s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fba6f6ad-24d8-41c8-9c86-74eae4239356 tempest-CinderUnicodeTest-652145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2b4f45c-a9ce-4728-840e-0810a872b739 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.2c358ac4-8cc8-4f9e-a836-8582705935c7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:37 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2b4f45c-a9ce-4728-840e-0810a872b739 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.2c358ac4-8cc8-4f9e-a836-8582705935c7 Sep 04 16:04:37 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:37 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fba6f6ad-24d8-41c8-9c86-74eae4239356 tempest-CinderUnicodeTest-652145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2b4f45c-a9ce-4728-840e-0810a872b739 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.2c358ac4-8cc8-4f9e-a836-8582705935c7" returned: 0 in 0.314s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:37 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-fba6f6ad-24d8-41c8-9c86-74eae4239356 tempest-CinderUnicodeTest-652145621 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.2c358ac4-8cc8-4f9e-a836-8582705935c7 is being set with open permissions: ugo+rw Sep 04 16:04:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fba6f6ad-24d8-41c8-9c86-74eae4239356 tempest-CinderUnicodeTest-652145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.2c358ac4-8cc8-4f9e-a836-8582705935c7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:37 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.2c358ac4-8cc8-4f9e-a836-8582705935c7 Sep 04 16:04:37 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:37 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fba6f6ad-24d8-41c8-9c86-74eae4239356 tempest-CinderUnicodeTest-652145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.2c358ac4-8cc8-4f9e-a836-8582705935c7" returned: 0 in 0.268s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fba6f6ad-24d8-41c8-9c86-74eae4239356 tempest-CinderUnicodeTest-652145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:38 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.info Sep 04 16:04:38 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:38 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fba6f6ad-24d8-41c8-9c86-74eae4239356 tempest-CinderUnicodeTest-652145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.info" returned: 0 in 0.303s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:38 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-fba6f6ad-24d8-41c8-9c86-74eae4239356 tempest-CinderUnicodeTest-652145621 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.info is being set with open permissions: ugo+rw Sep 04 16:04:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fba6f6ad-24d8-41c8-9c86-74eae4239356 tempest-CinderUnicodeTest-652145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:38 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.info Sep 04 16:04:38 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:38 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fba6f6ad-24d8-41c8-9c86-74eae4239356 tempest-CinderUnicodeTest-652145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.info" returned: 0 in 0.276s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fba6f6ad-24d8-41c8-9c86-74eae4239356 tempest-CinderUnicodeTest-652145621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.994s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:38 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-2e5f3237-dcdf-4b90-9730-d6c52f130d91 req-1825b4cb-60b6-43be-b391-2dd832f39689 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Terminate volume connection completed successfully. Sep 04 16:04:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-2e5f3237-dcdf-4b90-9730-d6c52f130d91 req-1825b4cb-60b6-43be-b391-2dd832f39689 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Deleting attachment 203dfb04-f2bb-400c-830c-75a7c6a099df. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 16:04:38 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-fba6f6ad-24d8-41c8-9c86-74eae4239356 tempest-CinderUnicodeTest-652145621 None] Create snapshot completed successfully Sep 04 16:04:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5fe55a26-e9d9-47f4-8a76-11ef9ebb50d7 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Acquiring lock "cinder-8feddd7d-31be-4980-bc91-23b860d8ea7e-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5fe55a26-e9d9-47f4-8a76-11ef9ebb50d7 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Lock "cinder-8feddd7d-31be-4980-bc91-23b860d8ea7e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5fe55a26-e9d9-47f4-8a76-11ef9ebb50d7 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Acquiring lock "cinder-quobyte-8feddd7d-31be-4980-bc91-23b860d8ea7e" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5fe55a26-e9d9-47f4-8a76-11ef9ebb50d7 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Lock "cinder-quobyte-8feddd7d-31be-4980-bc91-23b860d8ea7e" acquired by "delete_volume" :: waited 0.014s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:39 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e29d1b-169a-4eb9-9301-20eb036f5111]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5fe55a26-e9d9-47f4-8a76-11ef9ebb50d7 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8feddd7d-31be-4980-bc91-23b860d8ea7e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:39 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8feddd7d-31be-4980-bc91-23b860d8ea7e Sep 04 16:04:39 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] Acquiring lock "cinder-2c358ac4-8cc8-4f9e-a836-8582705935c7-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] Lock "cinder-2c358ac4-8cc8-4f9e-a836-8582705935c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] Acquiring lock "cinder-quobyte-c2b4f45c-a9ce-4728-840e-0810a872b739" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] Lock "cinder-quobyte-c2b4f45c-a9ce-4728-840e-0810a872b739" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] Acquiring lock "cinder-quobyte-2c358ac4-8cc8-4f9e-a836-8582705935c7" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] Lock "cinder-quobyte-2c358ac4-8cc8-4f9e-a836-8582705935c7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] Deleting offline snapshot 2c358ac4-8cc8-4f9e-a836-8582705935c7 of volume c2b4f45c-a9ce-4728-840e-0810a872b739 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:04:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] snapshot_file for this snap is: volume-c2b4f45c-a9ce-4728-840e-0810a872b739.2c358ac4-8cc8-4f9e-a836-8582705935c7 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:04:39 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0520fe68-d31f-4ab6-9b97-8f4f912f7df7]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.2c358ac4-8cc8-4f9e-a836-8582705935c7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:39 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5fe55a26-e9d9-47f4-8a76-11ef9ebb50d7 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8feddd7d-31be-4980-bc91-23b860d8ea7e" returned: 0 in 0.401s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5fe55a26-e9d9-47f4-8a76-11ef9ebb50d7 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8feddd7d-31be-4980-bc91-23b860d8ea7e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:40 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.2c358ac4-8cc8-4f9e-a836-8582705935c7 Sep 04 16:04:40 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:40 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8feddd7d-31be-4980-bc91-23b860d8ea7e Sep 04 16:04:40 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:40 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5fe55a26-e9d9-47f4-8a76-11ef9ebb50d7 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8feddd7d-31be-4980-bc91-23b860d8ea7e" returned: 0 in 0.242s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5fe55a26-e9d9-47f4-8a76-11ef9ebb50d7 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Lock "cinder-quobyte-8feddd7d-31be-4980-bc91-23b860d8ea7e" released by "delete_volume" :: held 0.681s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:40 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-5fe55a26-e9d9-47f4-8a76-11ef9ebb50d7 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Created reservations ['6f0f64c1-0186-4c8b-b22f-977b415c17a0', 'c186a875-9ad4-47ac-ae00-9ac1ab932357', '952adf53-a708-4e3a-9c87-acd9ae6a75d5', '24b32585-def4-4fa1-8cef-9939b87fff10'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:40 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.2c358ac4-8cc8-4f9e-a836-8582705935c7" returned: 0 in 0.424s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2b4f45c-a9ce-4728-840e-0810a872b739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:04:40 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d894bf7f-ade8-4bb0-ad42-b10acbe8df2e]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5fe55a26-e9d9-47f4-8a76-11ef9ebb50d7 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5fe55a26-e9d9-47f4-8a76-11ef9ebb50d7 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5fe55a26-e9d9-47f4-8a76-11ef9ebb50d7 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:04:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5fe55a26-e9d9-47f4-8a76-11ef9ebb50d7 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:04:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5fe55a26-e9d9-47f4-8a76-11ef9ebb50d7 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5fe55a26-e9d9-47f4-8a76-11ef9ebb50d7 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:40 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:04:40 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:40 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739 Sep 04 16:04:40 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:40 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5fe55a26-e9d9-47f4-8a76-11ef9ebb50d7 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.251s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:40 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-5fe55a26-e9d9-47f4-8a76-11ef9ebb50d7 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:40 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-5fe55a26-e9d9-47f4-8a76-11ef9ebb50d7 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Deleted volume successfully. Sep 04 16:04:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5fe55a26-e9d9-47f4-8a76-11ef9ebb50d7 tempest-TestServerVolumeAttachScenarioOldVersion-1396817702 None] Lock "cinder-8feddd7d-31be-4980-bc91-23b860d8ea7e-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:40 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739" returned: 0 in 0.422s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.2c358ac4-8cc8-4f9e-a836-8582705935c7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:40 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.2c358ac4-8cc8-4f9e-a836-8582705935c7 Sep 04 16:04:40 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:41 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.2c358ac4-8cc8-4f9e-a836-8582705935c7" returned: 0 in 0.560s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.2c358ac4-8cc8-4f9e-a836-8582705935c7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:41 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.2c358ac4-8cc8-4f9e-a836-8582705935c7 Sep 04 16:04:41 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:41 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739.2c358ac4-8cc8-4f9e-a836-8582705935c7" returned: 0 in 0.306s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] Lock "cinder-quobyte-2c358ac4-8cc8-4f9e-a836-8582705935c7" released by "_delete_snapshot" :: held 1.844s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] Lock "cinder-quobyte-c2b4f45c-a9ce-4728-840e-0810a872b739" released by "delete_snapshot" :: held 1.869s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:41 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] Created reservations ['d06e43ec-421d-4a97-b635-a22f7ac73b96', '3c9c8034-7e77-450f-aa0f-4a0e3372789e', '4035bbbc-540e-4488-a61f-feefee6c346d', 'b5990439-26f1-4945-b51c-441fda5ee123'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:41 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] Delete snapshot completed successfully. Sep 04 16:04:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-975d3f71-64cd-480f-9906-5d2c45d15409 tempest-CinderUnicodeTest-652145621 None] Lock "cinder-2c358ac4-8cc8-4f9e-a836-8582705935c7-delete_snapshot" released by "delete_snapshot" :: held 2.053s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8fb0f2a1-7149-4cdb-bd3e-66675ac2685a tempest-CinderUnicodeTest-652145621 None] Acquiring lock "cinder-c2b4f45c-a9ce-4728-840e-0810a872b739-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8fb0f2a1-7149-4cdb-bd3e-66675ac2685a tempest-CinderUnicodeTest-652145621 None] Lock "cinder-c2b4f45c-a9ce-4728-840e-0810a872b739-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8fb0f2a1-7149-4cdb-bd3e-66675ac2685a tempest-CinderUnicodeTest-652145621 None] Acquiring lock "cinder-quobyte-c2b4f45c-a9ce-4728-840e-0810a872b739" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8fb0f2a1-7149-4cdb-bd3e-66675ac2685a tempest-CinderUnicodeTest-652145621 None] Lock "cinder-quobyte-c2b4f45c-a9ce-4728-840e-0810a872b739" acquired by "delete_volume" :: waited 0.013s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:42 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f8239c-5ab4-4254-837c-70ef2a1529d7]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8fb0f2a1-7149-4cdb-bd3e-66675ac2685a tempest-CinderUnicodeTest-652145621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:42 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739 Sep 04 16:04:42 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:42 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8fb0f2a1-7149-4cdb-bd3e-66675ac2685a tempest-CinderUnicodeTest-652145621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739" returned: 0 in 0.402s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8fb0f2a1-7149-4cdb-bd3e-66675ac2685a tempest-CinderUnicodeTest-652145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:42 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739 Sep 04 16:04:42 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:42 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8fb0f2a1-7149-4cdb-bd3e-66675ac2685a tempest-CinderUnicodeTest-652145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c2b4f45c-a9ce-4728-840e-0810a872b739" returned: 0 in 0.291s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8fb0f2a1-7149-4cdb-bd3e-66675ac2685a tempest-CinderUnicodeTest-652145621 None] Lock "cinder-quobyte-c2b4f45c-a9ce-4728-840e-0810a872b739" released by "delete_volume" :: held 0.763s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:42 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-8fb0f2a1-7149-4cdb-bd3e-66675ac2685a tempest-CinderUnicodeTest-652145621 None] Created reservations ['38265dea-2223-4288-9198-84b6491396ca', '7c9b8ac0-9860-4a8d-8a06-190bcf43827b', 'c785f24d-85da-4cc1-8b66-b36801792f44', '8621c711-5335-4587-b42a-346692e266e4'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8fb0f2a1-7149-4cdb-bd3e-66675ac2685a tempest-CinderUnicodeTest-652145621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8fb0f2a1-7149-4cdb-bd3e-66675ac2685a tempest-CinderUnicodeTest-652145621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8fb0f2a1-7149-4cdb-bd3e-66675ac2685a tempest-CinderUnicodeTest-652145621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:04:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8fb0f2a1-7149-4cdb-bd3e-66675ac2685a tempest-CinderUnicodeTest-652145621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:04:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8fb0f2a1-7149-4cdb-bd3e-66675ac2685a tempest-CinderUnicodeTest-652145621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8fb0f2a1-7149-4cdb-bd3e-66675ac2685a tempest-CinderUnicodeTest-652145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:43 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:04:43 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bc684e92-2712-465c-b166-a7d6026ab540 tempest-CinderUnicodeTest-652145621 None] Acquiring lock "cinder-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bc684e92-2712-465c-b166-a7d6026ab540 tempest-CinderUnicodeTest-652145621 None] Lock "cinder-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:43 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8fb0f2a1-7149-4cdb-bd3e-66675ac2685a tempest-CinderUnicodeTest-652145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.305s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:43 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-8fb0f2a1-7149-4cdb-bd3e-66675ac2685a tempest-CinderUnicodeTest-652145621 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:43 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-8fb0f2a1-7149-4cdb-bd3e-66675ac2685a tempest-CinderUnicodeTest-652145621 None] Deleted volume successfully. Sep 04 16:04:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8fb0f2a1-7149-4cdb-bd3e-66675ac2685a tempest-CinderUnicodeTest-652145621 None] Lock "cinder-c2b4f45c-a9ce-4728-840e-0810a872b739-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bc684e92-2712-465c-b166-a7d6026ab540 tempest-CinderUnicodeTest-652145621 None] Acquiring lock "cinder-quobyte-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bc684e92-2712-465c-b166-a7d6026ab540 tempest-CinderUnicodeTest-652145621 None] Lock "cinder-quobyte-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b" acquired by "delete_volume" :: waited 0.014s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:43 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e926e4-27f2-4796-8fd6-b28c0344a733]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bc684e92-2712-465c-b166-a7d6026ab540 tempest-CinderUnicodeTest-652145621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:43 devstack sudo[103416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b Sep 04 16:04:43 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:43 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bc684e92-2712-465c-b166-a7d6026ab540 tempest-CinderUnicodeTest-652145621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b" returned: 0 in 0.408s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bc684e92-2712-465c-b166-a7d6026ab540 tempest-CinderUnicodeTest-652145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:43 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b Sep 04 16:04:43 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:44 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bc684e92-2712-465c-b166-a7d6026ab540 tempest-CinderUnicodeTest-652145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b" returned: 0 in 0.263s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bc684e92-2712-465c-b166-a7d6026ab540 tempest-CinderUnicodeTest-652145621 None] Lock "cinder-quobyte-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b" released by "delete_volume" :: held 0.712s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:44 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-bc684e92-2712-465c-b166-a7d6026ab540 tempest-CinderUnicodeTest-652145621 None] Created reservations ['f300523c-72ec-4d14-8c32-3cce2aaa0548', '86d7e12f-667c-4f3c-93af-2b18b030cb30', '7262da2f-d1c3-42ea-ada4-6ca6e7f96366', '78927a34-2358-48cd-9521-5c386c285ee3'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bc684e92-2712-465c-b166-a7d6026ab540 tempest-CinderUnicodeTest-652145621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bc684e92-2712-465c-b166-a7d6026ab540 tempest-CinderUnicodeTest-652145621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bc684e92-2712-465c-b166-a7d6026ab540 tempest-CinderUnicodeTest-652145621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:04:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bc684e92-2712-465c-b166-a7d6026ab540 tempest-CinderUnicodeTest-652145621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:04:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bc684e92-2712-465c-b166-a7d6026ab540 tempest-CinderUnicodeTest-652145621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bc684e92-2712-465c-b166-a7d6026ab540 tempest-CinderUnicodeTest-652145621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:44 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:04:44 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:44 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bc684e92-2712-465c-b166-a7d6026ab540 tempest-CinderUnicodeTest-652145621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.274s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:44 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bc684e92-2712-465c-b166-a7d6026ab540 tempest-CinderUnicodeTest-652145621 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:44 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-bc684e92-2712-465c-b166-a7d6026ab540 tempest-CinderUnicodeTest-652145621 None] Deleted volume successfully. Sep 04 16:04:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bc684e92-2712-465c-b166-a7d6026ab540 tempest-CinderUnicodeTest-652145621 None] Lock "cinder-ccb4d9fe-3143-4278-8dca-bb5ab70fa07b-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:54 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=98,cinder:INSERT=28,cinder:UPDATE=117,cinder:DELETE=9 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:04:54 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=123,cinder:SELECT=84,cinder:DELETE=12,cinder:INSERT=36 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Flow 'volume_create_manager' (68b9ad7f-045a-4a00-9cdd-327e51ae7744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b52f77-b1af-47ff-9852-55c7da5c2435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b52f77-b1af-47ff-9852-55c7da5c2435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2113597397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c65a48c-9fee-4eb5-a542-19f6c8314b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb927057e1884474a9a0a4715d3b3476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:18Z,use_quota=True,user_id='d098c6cd42854ad0ad48f024e0db8c3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d150ef9-2606-466c-8661-ea8cfa7694a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d150ef9-2606-466c-8661-ea8cfa7694a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f74ef99-82ca-46c1-b117-d944a6254dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f74ef99-82ca-46c1-b117-d944a6254dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c65a48c-9fee-4eb5-a542-19f6c8314b66', 'volume_name': 'volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0236fe-a938-4538-9c71-a06ed3de3189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0236fe-a938-4538-9c71-a06ed3de3189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97d5ad5-eb08-4086-96bd-489102466ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:17 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Volume 1c65a48c-9fee-4eb5-a542-19f6c8314b66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66', 'volume_size': 1} Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2113597397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c65a48c-9fee-4eb5-a542-19f6c8314b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb927057e1884474a9a0a4715d3b3476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:18Z,use_quota=True,user_id='d098c6cd42854ad0ad48f024e0db8c3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Creating volume 1c65a48c-9fee-4eb5-a542-19f6c8314b66 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:05:17 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:05:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:17 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 1073741824 Sep 04 16:05:17 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:18 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 1073741824" returned: 0 in 0.451s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:18 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 Sep 04 16:05:18 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:18 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66" returned: 0 in 0.257s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:18 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:05:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:18 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97d5ad5-eb08-4086-96bd-489102466ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:18 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e844822-318a-43e5-8fac-0246ff6ca22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:18 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Volume volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 (1c65a48c-9fee-4eb5-a542-19f6c8314b66): created successfully Sep 04 16:05:18 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e844822-318a-43e5-8fac-0246ff6ca22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:18 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Flow 'volume_create_manager' (68b9ad7f-045a-4a00-9cdd-327e51ae7744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:18 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-44270275-0d72-418d-b1c0-bf82f1f0abae tempest-SnapshotDependencyTests-458872899 None] Created volume successfully. Sep 04 16:05:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b9acbf6d-161d-482f-9ab3-6b16a48fb39d tempest-SnapshotDependencyTests-458872899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b9acbf6d-161d-482f-9ab3-6b16a48fb39d tempest-SnapshotDependencyTests-458872899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:18 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-b9acbf6d-161d-482f-9ab3-6b16a48fb39d tempest-SnapshotDependencyTests-458872899 None] Creating offline snapshot 9dfaf801-8ae7-4acd-9658-96b5b6b26607 of volume 1c65a48c-9fee-4eb5-a542-19f6c8314b66 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:05:18 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd8eda5-ce7d-4445-9c89-d2c9bc62cb71]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b9acbf6d-161d-482f-9ab3-6b16a48fb39d tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:19 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 Sep 04 16:05:19 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:19 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b9acbf6d-161d-482f-9ab3-6b16a48fb39d tempest-SnapshotDependencyTests-458872899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66" returned: 0 in 0.506s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b9acbf6d-161d-482f-9ab3-6b16a48fb39d tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:19 devstack sudo[103492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607 1G Sep 04 16:05:19 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:19 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b9acbf6d-161d-482f-9ab3-6b16a48fb39d tempest-SnapshotDependencyTests-458872899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607 1G" returned: 0 in 0.440s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b9acbf6d-161d-482f-9ab3-6b16a48fb39d tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:19 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607 Sep 04 16:05:19 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:20 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b9acbf6d-161d-482f-9ab3-6b16a48fb39d tempest-SnapshotDependencyTests-458872899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607" returned: 0 in 0.291s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:20 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-b9acbf6d-161d-482f-9ab3-6b16a48fb39d tempest-SnapshotDependencyTests-458872899 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607 is being set with open permissions: ugo+rw Sep 04 16:05:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b9acbf6d-161d-482f-9ab3-6b16a48fb39d tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:20 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607 Sep 04 16:05:20 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:20 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b9acbf6d-161d-482f-9ab3-6b16a48fb39d tempest-SnapshotDependencyTests-458872899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607" returned: 0 in 0.247s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b9acbf6d-161d-482f-9ab3-6b16a48fb39d tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:20 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.info Sep 04 16:05:20 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:20 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b9acbf6d-161d-482f-9ab3-6b16a48fb39d tempest-SnapshotDependencyTests-458872899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.info" returned: 0 in 0.260s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:20 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-b9acbf6d-161d-482f-9ab3-6b16a48fb39d tempest-SnapshotDependencyTests-458872899 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.info is being set with open permissions: ugo+rw Sep 04 16:05:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b9acbf6d-161d-482f-9ab3-6b16a48fb39d tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:20 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.info Sep 04 16:05:20 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:20 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b9acbf6d-161d-482f-9ab3-6b16a48fb39d tempest-SnapshotDependencyTests-458872899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.info" returned: 0 in 0.255s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b9acbf6d-161d-482f-9ab3-6b16a48fb39d tempest-SnapshotDependencyTests-458872899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:21 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b9acbf6d-161d-482f-9ab3-6b16a48fb39d tempest-SnapshotDependencyTests-458872899 None] Create snapshot completed successfully Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Flow 'volume_create_manager' (3cc43590-fca2-41c7-8fd1-e7e9a119459a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f0c6987-753a-4912-8732-2d865dc0c2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f0c6987-753a-4912-8732-2d865dc0c2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cbd9e5c-98d8-45f9-bc05-6f2fa3081123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb927057e1884474a9a0a4715d3b3476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9dfaf801-8ae7-4acd-9658-96b5b6b26607,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:23Z,use_quota=True,user_id='d098c6cd42854ad0ad48f024e0db8c3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043dce63-a5c7-4b67-8aa8-d7ac87b5449f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043dce63-a5c7-4b67-8aa8-d7ac87b5449f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836c2c34-fbfb-4cf9-869f-053190241581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836c2c34-fbfb-4cf9-869f-053190241581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4cbd9e5c-98d8-45f9-bc05-6f2fa3081123', 'volume_name': 'volume-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123', 'volume_size': 1, 'snapshot_id': '9dfaf801-8ae7-4acd-9658-96b5b6b26607'}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04615b50-1947-46ee-b315-94537a977b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04615b50-1947-46ee-b315-94537a977b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3710c77-f258-419f-973a-cd9b08f732c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:22 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Volume 4cbd9e5c-98d8-45f9-bc05-6f2fa3081123: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123', 'volume_size': 1, 'snapshot_id': '9dfaf801-8ae7-4acd-9658-96b5b6b26607'} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Acquiring lock "cinder-quobyte-9dfaf801-8ae7-4acd-9658-96b5b6b26607-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123" by "_create_volume_from_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Lock "cinder-quobyte-9dfaf801-8ae7-4acd-9658-96b5b6b26607-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Creating volume 4cbd9e5c-98d8-45f9-bc05-6f2fa3081123 from snapshot 9dfaf801-8ae7-4acd-9658-96b5b6b26607 {{(pid=87513) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Acquiring lock "cinder-quobyte-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123" by "_copy_volume_from_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Lock "cinder-quobyte-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] snapshot: 9dfaf801-8ae7-4acd-9658-96b5b6b26607, volume: 4cbd9e5c-98d8-45f9-bc05-6f2fa3081123, {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[85407dcd-bfea-4054-951b-2362a3cfafc7]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:23 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607 Sep 04 16:05:23 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:23 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607" returned: 0 in 0.437s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:05:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] will copy from snapshot at /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 04 16:05:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Creating direct copy from snapshot {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 04 16:05:23 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afa8549-6199-4ac4-bfcb-7df2bd8384b2]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:23 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 Sep 04 16:05:23 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:23 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66" returned: 0 in 0.437s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:23 devstack cinder-volume[87513]: DEBUG cinder.utils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Path /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123 not found in is_blk_device check {{(pid=87513) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 04 16:05:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:23 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123 Sep 04 16:05:23 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:25 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:05:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Flow 'volume_create_manager' (51db91fa-df8c-4d8e-aec7-9ee64b0ac3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677c3868-b3a3-415f-9c35-009c355849b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677c3868-b3a3-415f-9c35-009c355849b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1813244303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87aa51af-5fa7-45c1-b744-c8c7df51c30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47ed178234047159562c0a3cace2909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:26Z,use_quota=True,user_id='a16a42b467724d75bfb4819ac6d20a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f9f012-10c4-4bc9-a6f2-184938a8f104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f9f012-10c4-4bc9-a6f2-184938a8f104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11cd8da7-bed5-4436-9afb-c43f351dbf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11cd8da7-bed5-4436-9afb-c43f351dbf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87aa51af-5fa7-45c1-b744-c8c7df51c30c', 'volume_name': 'volume-87aa51af-5fa7-45c1-b744-c8c7df51c30c', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d1bb2a-5405-48a6-841b-f8c23a3fd161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d1bb2a-5405-48a6-841b-f8c23a3fd161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (866beb72-77a6-412e-b8d9-f2aa93647c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:25 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Volume 87aa51af-5fa7-45c1-b744-c8c7df51c30c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87aa51af-5fa7-45c1-b744-c8c7df51c30c', 'volume_size': 1} Sep 04 16:05:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:26 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:05:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Flow 'volume_create_manager' (2b60ebdc-7d79-4d9c-b50b-0aadd1affac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c586dbf-1935-4e6e-ad8a-9075f40760d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c586dbf-1935-4e6e-ad8a-9075f40760d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-318991291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7cae4d-74cf-4e12-8421-d6c0eda72380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47ed178234047159562c0a3cace2909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:26Z,use_quota=True,user_id='a16a42b467724d75bfb4819ac6d20a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be52cc5-b418-4a1e-b126-6bc27e1153a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be52cc5-b418-4a1e-b126-6bc27e1153a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c079271-6a78-4dc1-927f-a4fecfbeb5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c079271-6a78-4dc1-927f-a4fecfbeb5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b7cae4d-74cf-4e12-8421-d6c0eda72380', 'volume_name': 'volume-8b7cae4d-74cf-4e12-8421-d6c0eda72380', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5da99f-1868-4267-b970-ecbc0284d5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5da99f-1868-4267-b970-ecbc0284d5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78eb6ef8-3cad-4624-8e8e-90affbdb98d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:26 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Volume 8b7cae4d-74cf-4e12-8421-d6c0eda72380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b7cae4d-74cf-4e12-8421-d6c0eda72380', 'volume_size': 1} Sep 04 16:05:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:28 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123" returned: 0 in 4.963s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:28 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fe0698-d40d-4f9a-8b46-279867a3542c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:28 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 Sep 04 16:05:28 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:29 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66" returned: 0 in 0.516s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:29 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Image conversion details: src /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66, size 1024.00 MB, duration 4.96 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123 {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:05:29 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Converted 1024.00 MB image at 206.28 MB/s Sep 04 16:05:29 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123 is being set with open permissions: ugo+rw Sep 04 16:05:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:29 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123 Sep 04 16:05:29 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:29 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123" returned: 0 in 0.233s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:29 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Lock "cinder-quobyte-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123" released by "_copy_volume_from_snapshot" :: held 6.681s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:29 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Lock "cinder-quobyte-9dfaf801-8ae7-4acd-9658-96b5b6b26607-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123" released by "_create_volume_from_snapshot" :: held 6.713s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.730s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.586s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:29 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1813244303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87aa51af-5fa7-45c1-b744-c8c7df51c30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47ed178234047159562c0a3cace2909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:26Z,use_quota=True,user_id='a16a42b467724d75bfb4819ac6d20a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:05:29 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Creating volume 87aa51af-5fa7-45c1-b744-c8c7df51c30c {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:05:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:29 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:05:29 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:05:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:29 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:05:29 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:05:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87aa51af-5fa7-45c1-b744-c8c7df51c30c 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:29 devstack sudo[103551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87aa51af-5fa7-45c1-b744-c8c7df51c30c 1073741824 Sep 04 16:05:29 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3710c77-f258-419f-973a-cd9b08f732c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123', 'volume_size': 1, 'snapshot_id': '9dfaf801-8ae7-4acd-9658-96b5b6b26607'}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8aba443-b6fa-4c11-ab3c-ec73c1154ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:29 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Volume volume-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123 (4cbd9e5c-98d8-45f9-bc05-6f2fa3081123): created successfully Sep 04 16:05:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8aba443-b6fa-4c11-ab3c-ec73c1154ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Flow 'volume_create_manager' (3cc43590-fca2-41c7-8fd1-e7e9a119459a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:29 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ac15546d-0b34-41ed-aa0c-ffcd52215a3b tempest-SnapshotDependencyTests-458872899 None] Created volume successfully. Sep 04 16:05:30 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87aa51af-5fa7-45c1-b744-c8c7df51c30c 1073741824" returned: 0 in 0.442s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87aa51af-5fa7-45c1-b744-c8c7df51c30c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:30 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87aa51af-5fa7-45c1-b744-c8c7df51c30c Sep 04 16:05:30 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:30 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87aa51af-5fa7-45c1-b744-c8c7df51c30c" returned: 0 in 0.264s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.517s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-318991291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7cae4d-74cf-4e12-8421-d6c0eda72380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47ed178234047159562c0a3cace2909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:26Z,use_quota=True,user_id='a16a42b467724d75bfb4819ac6d20a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Creating volume 8b7cae4d-74cf-4e12-8421-d6c0eda72380 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:05:30 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8b7cae4d-74cf-4e12-8421-d6c0eda72380 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (866beb72-77a6-412e-b8d9-f2aa93647c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87aa51af-5fa7-45c1-b744-c8c7df51c30c', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9a9e1c-e497-4ea7-b6a0-f0e283380a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:30 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8b7cae4d-74cf-4e12-8421-d6c0eda72380 1073741824 Sep 04 16:05:30 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:30 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Volume volume-87aa51af-5fa7-45c1-b744-c8c7df51c30c (87aa51af-5fa7-45c1-b744-c8c7df51c30c): created successfully Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9a9e1c-e497-4ea7-b6a0-f0e283380a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Flow 'volume_create_manager' (51db91fa-df8c-4d8e-aec7-9ee64b0ac3d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:30 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-760c7adf-b34c-4f65-89b9-a58105745849 tempest-TestServerVolumeAttachmentScenario-272926025 None] Created volume successfully. Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] Acquiring lock "cinder-9dfaf801-8ae7-4acd-9658-96b5b6b26607-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] Lock "cinder-9dfaf801-8ae7-4acd-9658-96b5b6b26607-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] Acquiring lock "cinder-quobyte-1c65a48c-9fee-4eb5-a542-19f6c8314b66" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] Lock "cinder-quobyte-1c65a48c-9fee-4eb5-a542-19f6c8314b66" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] Acquiring lock "cinder-quobyte-9dfaf801-8ae7-4acd-9658-96b5b6b26607" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] Lock "cinder-quobyte-9dfaf801-8ae7-4acd-9658-96b5b6b26607" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] Deleting offline snapshot 9dfaf801-8ae7-4acd-9658-96b5b6b26607 of volume 1c65a48c-9fee-4eb5-a542-19f6c8314b66 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] snapshot_file for this snap is: volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fd9bb3-2907-48d3-a2cd-85d631547933]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:30 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607 Sep 04 16:05:30 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:30 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8b7cae4d-74cf-4e12-8421-d6c0eda72380 1073741824" returned: 0 in 0.583s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8b7cae4d-74cf-4e12-8421-d6c0eda72380 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:30 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8b7cae4d-74cf-4e12-8421-d6c0eda72380 Sep 04 16:05:30 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:31 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607" returned: 0 in 0.425s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:05:31 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f691ddbc-5fb0-4262-9d77-3e5a757181fb]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:31 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8b7cae4d-74cf-4e12-8421-d6c0eda72380" returned: 0 in 0.286s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:05:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78eb6ef8-3cad-4624-8e8e-90affbdb98d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b7cae4d-74cf-4e12-8421-d6c0eda72380', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c82717-32cb-41dc-9d74-033a15605fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:31 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Volume volume-8b7cae4d-74cf-4e12-8421-d6c0eda72380 (8b7cae4d-74cf-4e12-8421-d6c0eda72380): created successfully Sep 04 16:05:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c82717-32cb-41dc-9d74-033a15605fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Flow 'volume_create_manager' (2b60ebdc-7d79-4d9c-b50b-0aadd1affac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:31 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 Sep 04 16:05:31 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:31 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-f827c7ec-3d09-41b2-b6a1-9d1cc64a1aaa tempest-TestServerVolumeAttachmentScenario-272926025 None] Created volume successfully. Sep 04 16:05:31 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66" returned: 0 in 0.393s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:31 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607 Sep 04 16:05:31 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:32 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607" returned: 0 in 0.418s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:32 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607 Sep 04 16:05:32 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:32 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66.9dfaf801-8ae7-4acd-9658-96b5b6b26607" returned: 0 in 0.278s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] Lock "cinder-quobyte-9dfaf801-8ae7-4acd-9658-96b5b6b26607" released by "_delete_snapshot" :: held 1.633s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] Lock "cinder-quobyte-1c65a48c-9fee-4eb5-a542-19f6c8314b66" released by "delete_snapshot" :: held 1.664s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:32 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] Created reservations ['4ae69b0b-6486-4947-b3dc-d0114dcaa075', '5ab0835c-5038-4b22-ba8d-8b393b0c94d8', '716d3b30-0a9f-4fdc-a037-2f94d7f7bde0', '74ca109e-dde7-45bc-938f-dadb52eff95e'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:05:32 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] Delete snapshot completed successfully. Sep 04 16:05:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-15b153b9-70af-41d9-b555-ab48a2f6c74a tempest-SnapshotDependencyTests-458872899 None] Lock "cinder-9dfaf801-8ae7-4acd-9658-96b5b6b26607-delete_snapshot" released by "delete_snapshot" :: held 1.899s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-00be2c92-a5a3-49e9-b530-5eced7022a38 tempest-SnapshotDependencyTests-458872899 None] Acquiring lock "cinder-1c65a48c-9fee-4eb5-a542-19f6c8314b66-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-00be2c92-a5a3-49e9-b530-5eced7022a38 tempest-SnapshotDependencyTests-458872899 None] Lock "cinder-1c65a48c-9fee-4eb5-a542-19f6c8314b66-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-00be2c92-a5a3-49e9-b530-5eced7022a38 tempest-SnapshotDependencyTests-458872899 None] Acquiring lock "cinder-quobyte-1c65a48c-9fee-4eb5-a542-19f6c8314b66" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-00be2c92-a5a3-49e9-b530-5eced7022a38 tempest-SnapshotDependencyTests-458872899 None] Lock "cinder-quobyte-1c65a48c-9fee-4eb5-a542-19f6c8314b66" acquired by "delete_volume" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:32 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[967c0f21-0dd2-4ac7-be6e-06d941fd5435]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-00be2c92-a5a3-49e9-b530-5eced7022a38 tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:33 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 Sep 04 16:05:33 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:33 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-00be2c92-a5a3-49e9-b530-5eced7022a38 tempest-SnapshotDependencyTests-458872899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66" returned: 0 in 0.378s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-00be2c92-a5a3-49e9-b530-5eced7022a38 tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:33 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66 Sep 04 16:05:33 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:33 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-00be2c92-a5a3-49e9-b530-5eced7022a38 tempest-SnapshotDependencyTests-458872899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1c65a48c-9fee-4eb5-a542-19f6c8314b66" returned: 0 in 0.243s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:33 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-00be2c92-a5a3-49e9-b530-5eced7022a38 tempest-SnapshotDependencyTests-458872899 None] Lock "cinder-quobyte-1c65a48c-9fee-4eb5-a542-19f6c8314b66" released by "delete_volume" :: held 0.681s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:33 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-00be2c92-a5a3-49e9-b530-5eced7022a38 tempest-SnapshotDependencyTests-458872899 None] Created reservations ['467fb2cd-328d-4dbb-a7e8-2ffd593fd5f1', 'd26791f4-edea-4db4-8773-7e490ec977ca', '2469bf14-906e-447d-ae26-e492e6c8f175', 'dac531af-09cc-45ce-baa9-9bac315e7aa1'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:05:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-00be2c92-a5a3-49e9-b530-5eced7022a38 tempest-SnapshotDependencyTests-458872899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-00be2c92-a5a3-49e9-b530-5eced7022a38 tempest-SnapshotDependencyTests-458872899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-00be2c92-a5a3-49e9-b530-5eced7022a38 tempest-SnapshotDependencyTests-458872899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:05:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-00be2c92-a5a3-49e9-b530-5eced7022a38 tempest-SnapshotDependencyTests-458872899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:05:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-00be2c92-a5a3-49e9-b530-5eced7022a38 tempest-SnapshotDependencyTests-458872899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-00be2c92-a5a3-49e9-b530-5eced7022a38 tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:33 devstack sudo[103616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:05:33 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:34 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4e33df33-290d-474b-981f-9c94452f8f91 tempest-SnapshotDependencyTests-458872899 None] Acquiring lock "cinder-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-00be2c92-a5a3-49e9-b530-5eced7022a38 tempest-SnapshotDependencyTests-458872899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.300s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:34 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-00be2c92-a5a3-49e9-b530-5eced7022a38 tempest-SnapshotDependencyTests-458872899 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:05:34 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-00be2c92-a5a3-49e9-b530-5eced7022a38 tempest-SnapshotDependencyTests-458872899 None] Deleted volume successfully. Sep 04 16:05:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4e33df33-290d-474b-981f-9c94452f8f91 tempest-SnapshotDependencyTests-458872899 None] Lock "cinder-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-00be2c92-a5a3-49e9-b530-5eced7022a38 tempest-SnapshotDependencyTests-458872899 None] Lock "cinder-1c65a48c-9fee-4eb5-a542-19f6c8314b66-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4e33df33-290d-474b-981f-9c94452f8f91 tempest-SnapshotDependencyTests-458872899 None] Acquiring lock "cinder-quobyte-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4e33df33-290d-474b-981f-9c94452f8f91 tempest-SnapshotDependencyTests-458872899 None] Lock "cinder-quobyte-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123" acquired by "delete_volume" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:34 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc762072-2dde-43a6-87ba-5e393bfa8001]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4e33df33-290d-474b-981f-9c94452f8f91 tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:34 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123 Sep 04 16:05:34 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:34 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4e33df33-290d-474b-981f-9c94452f8f91 tempest-SnapshotDependencyTests-458872899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123" returned: 0 in 0.573s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4e33df33-290d-474b-981f-9c94452f8f91 tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:34 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123 Sep 04 16:05:34 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:05:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:05:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:05:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:35 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:05:35 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:35 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4e33df33-290d-474b-981f-9c94452f8f91 tempest-SnapshotDependencyTests-458872899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123" returned: 0 in 0.359s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4e33df33-290d-474b-981f-9c94452f8f91 tempest-SnapshotDependencyTests-458872899 None] Lock "cinder-quobyte-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123" released by "delete_volume" :: held 0.990s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:35 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-4e33df33-290d-474b-981f-9c94452f8f91 tempest-SnapshotDependencyTests-458872899 None] Created reservations ['de8ebc52-a0e2-42eb-9508-2fd7416ee580', '36f58db4-b0ff-4fa8-ac3b-d2607e838522', '814c4e87-2a3f-458e-8393-dbfc2bf8eef8', '0922bb8a-03ae-4724-ad42-8a1c760c235a'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:05:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4e33df33-290d-474b-981f-9c94452f8f91 tempest-SnapshotDependencyTests-458872899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4e33df33-290d-474b-981f-9c94452f8f91 tempest-SnapshotDependencyTests-458872899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4e33df33-290d-474b-981f-9c94452f8f91 tempest-SnapshotDependencyTests-458872899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:05:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4e33df33-290d-474b-981f-9c94452f8f91 tempest-SnapshotDependencyTests-458872899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:05:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4e33df33-290d-474b-981f-9c94452f8f91 tempest-SnapshotDependencyTests-458872899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4e33df33-290d-474b-981f-9c94452f8f91 tempest-SnapshotDependencyTests-458872899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:35 devstack sudo[103693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:05:35 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:35 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.558s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:05:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:05:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 28 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:05:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 16:05:35 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4e33df33-290d-474b-981f-9c94452f8f91 tempest-SnapshotDependencyTests-458872899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.308s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-4e33df33-290d-474b-981f-9c94452f8f91 tempest-SnapshotDependencyTests-458872899 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:05:35 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-4e33df33-290d-474b-981f-9c94452f8f91 tempest-SnapshotDependencyTests-458872899 None] Deleted volume successfully. Sep 04 16:05:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4e33df33-290d-474b-981f-9c94452f8f91 tempest-SnapshotDependencyTests-458872899 None] Lock "cinder-4cbd9e5c-98d8-45f9-bc05-6f2fa3081123-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:53 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=24,cinder:UPDATE=39,cinder:INSERT=11,cinder:DELETE=1 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:05:53 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=32,cinder:UPDATE=30,cinder:DELETE=6,cinder:INSERT=5 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:05:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-b11b0fe9-5203-4d9f-bb2d-a3eaade6b282 req-99349adb-62f8-4bf5-a64f-fd5fda4f4681 tempest-TestServerVolumeAttachmentScenario-272926025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-b11b0fe9-5203-4d9f-bb2d-a3eaade6b282 req-99349adb-62f8-4bf5-a64f-fd5fda4f4681 tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:59 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[628ebb43-3212-4bdf-bf3a-b3617c7b9b1a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-b11b0fe9-5203-4d9f-bb2d-a3eaade6b282 req-99349adb-62f8-4bf5-a64f-fd5fda4f4681 tempest-TestServerVolumeAttachmentScenario-272926025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87aa51af-5fa7-45c1-b744-c8c7df51c30c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:59 devstack sudo[103747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87aa51af-5fa7-45c1-b744-c8c7df51c30c Sep 04 16:05:59 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:59 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-b11b0fe9-5203-4d9f-bb2d-a3eaade6b282 req-99349adb-62f8-4bf5-a64f-fd5fda4f4681 tempest-TestServerVolumeAttachmentScenario-272926025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87aa51af-5fa7-45c1-b744-c8c7df51c30c" returned: 0 in 0.368s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-b11b0fe9-5203-4d9f-bb2d-a3eaade6b282 req-99349adb-62f8-4bf5-a64f-fd5fda4f4681 tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.385s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-b11b0fe9-5203-4d9f-bb2d-a3eaade6b282 req-99349adb-62f8-4bf5-a64f-fd5fda4f4681 tempest-TestServerVolumeAttachmentScenario-272926025 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-87aa51af-5fa7-45c1-b744-c8c7df51c30c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '576f47e3-4f80-4e20-8ad5-eb0eba4ae9a9', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 16:05:59 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-b11b0fe9-5203-4d9f-bb2d-a3eaade6b282 req-99349adb-62f8-4bf5-a64f-fd5fda4f4681 tempest-TestServerVolumeAttachmentScenario-272926025 None] attachment_update completed successfully. Sep 04 16:06:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-daefa784-6b58-4980-968a-eb1867f54d71 req-8bb9ec12-4913-4559-85ad-2504cf5e0f02 tempest-TestServerVolumeAttachmentScenario-272926025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-daefa784-6b58-4980-968a-eb1867f54d71 req-8bb9ec12-4913-4559-85ad-2504cf5e0f02 tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:04 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef0655d-f536-4ca7-a69c-9b56d5ce3f7a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-daefa784-6b58-4980-968a-eb1867f54d71 req-8bb9ec12-4913-4559-85ad-2504cf5e0f02 tempest-TestServerVolumeAttachmentScenario-272926025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8b7cae4d-74cf-4e12-8421-d6c0eda72380 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:04 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8b7cae4d-74cf-4e12-8421-d6c0eda72380 Sep 04 16:06:04 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:04 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-daefa784-6b58-4980-968a-eb1867f54d71 req-8bb9ec12-4913-4559-85ad-2504cf5e0f02 tempest-TestServerVolumeAttachmentScenario-272926025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8b7cae4d-74cf-4e12-8421-d6c0eda72380" returned: 0 in 0.376s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-daefa784-6b58-4980-968a-eb1867f54d71 req-8bb9ec12-4913-4559-85ad-2504cf5e0f02 tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.394s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:04 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-daefa784-6b58-4980-968a-eb1867f54d71 req-8bb9ec12-4913-4559-85ad-2504cf5e0f02 tempest-TestServerVolumeAttachmentScenario-272926025 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-8b7cae4d-74cf-4e12-8421-d6c0eda72380', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a11cdacc-0f42-43c9-a5c7-735b83484b55', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 16:06:04 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-daefa784-6b58-4980-968a-eb1867f54d71 req-8bb9ec12-4913-4559-85ad-2504cf5e0f02 tempest-TestServerVolumeAttachmentScenario-272926025 None] attachment_update completed successfully. Sep 04 16:06:06 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-288dd1a8-4bd3-4793-9cc7-6e5e98bcda46 req-080337ff-d714-491e-820e-10d54b5a8074 tempest-TestServerVolumeAttachmentScenario-272926025 None] Terminate volume connection completed successfully. Sep 04 16:06:06 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-288dd1a8-4bd3-4793-9cc7-6e5e98bcda46 req-080337ff-d714-491e-820e-10d54b5a8074 tempest-TestServerVolumeAttachmentScenario-272926025 None] Deleting attachment a11cdacc-0f42-43c9-a5c7-735b83484b55. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 16:06:08 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-8c0b5938-fdb3-4ac3-a75c-ac8d9e87aa90 req-06cffdeb-246d-44ce-b57f-140e95cc667b tempest-TestServerVolumeAttachmentScenario-272926025 None] Terminate volume connection completed successfully. Sep 04 16:06:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-8c0b5938-fdb3-4ac3-a75c-ac8d9e87aa90 req-06cffdeb-246d-44ce-b57f-140e95cc667b tempest-TestServerVolumeAttachmentScenario-272926025 None] Deleting attachment 576f47e3-4f80-4e20-8ad5-eb0eba4ae9a9. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 16:06:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-59135776-2a31-4d07-aa9f-fab9a881d1b3 tempest-TestServerVolumeAttachmentScenario-272926025 None] Acquiring lock "cinder-8b7cae4d-74cf-4e12-8421-d6c0eda72380-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-59135776-2a31-4d07-aa9f-fab9a881d1b3 tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "cinder-8b7cae4d-74cf-4e12-8421-d6c0eda72380-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-59135776-2a31-4d07-aa9f-fab9a881d1b3 tempest-TestServerVolumeAttachmentScenario-272926025 None] Acquiring lock "cinder-quobyte-8b7cae4d-74cf-4e12-8421-d6c0eda72380" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-59135776-2a31-4d07-aa9f-fab9a881d1b3 tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "cinder-quobyte-8b7cae4d-74cf-4e12-8421-d6c0eda72380" acquired by "delete_volume" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:13 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b67b54-6c90-4296-aaaf-7e160806c1a6]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-59135776-2a31-4d07-aa9f-fab9a881d1b3 tempest-TestServerVolumeAttachmentScenario-272926025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8b7cae4d-74cf-4e12-8421-d6c0eda72380 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:13 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8b7cae4d-74cf-4e12-8421-d6c0eda72380 Sep 04 16:06:13 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:13 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-59135776-2a31-4d07-aa9f-fab9a881d1b3 tempest-TestServerVolumeAttachmentScenario-272926025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8b7cae4d-74cf-4e12-8421-d6c0eda72380" returned: 0 in 0.397s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-59135776-2a31-4d07-aa9f-fab9a881d1b3 tempest-TestServerVolumeAttachmentScenario-272926025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8b7cae4d-74cf-4e12-8421-d6c0eda72380 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:13 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8b7cae4d-74cf-4e12-8421-d6c0eda72380 Sep 04 16:06:13 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:13 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-59135776-2a31-4d07-aa9f-fab9a881d1b3 tempest-TestServerVolumeAttachmentScenario-272926025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-8b7cae4d-74cf-4e12-8421-d6c0eda72380" returned: 0 in 0.243s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-59135776-2a31-4d07-aa9f-fab9a881d1b3 tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "cinder-quobyte-8b7cae4d-74cf-4e12-8421-d6c0eda72380" released by "delete_volume" :: held 0.681s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:13 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-59135776-2a31-4d07-aa9f-fab9a881d1b3 tempest-TestServerVolumeAttachmentScenario-272926025 None] Created reservations ['f6a49d77-37dd-4cf8-a162-3e4c8b7e8b25', '3ba8d72f-f06b-469f-a098-9e7fe4a22f97', '7b0a9575-2603-432c-9ca3-4316a265ec65', 'd4c5373a-75bd-4d5c-9f4d-e479607a4db4'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:06:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-59135776-2a31-4d07-aa9f-fab9a881d1b3 tempest-TestServerVolumeAttachmentScenario-272926025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-59135776-2a31-4d07-aa9f-fab9a881d1b3 tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-59135776-2a31-4d07-aa9f-fab9a881d1b3 tempest-TestServerVolumeAttachmentScenario-272926025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:06:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-59135776-2a31-4d07-aa9f-fab9a881d1b3 tempest-TestServerVolumeAttachmentScenario-272926025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:06:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-59135776-2a31-4d07-aa9f-fab9a881d1b3 tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-59135776-2a31-4d07-aa9f-fab9a881d1b3 tempest-TestServerVolumeAttachmentScenario-272926025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:13 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:06:13 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:14 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-59135776-2a31-4d07-aa9f-fab9a881d1b3 tempest-TestServerVolumeAttachmentScenario-272926025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.253s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:14 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-59135776-2a31-4d07-aa9f-fab9a881d1b3 tempest-TestServerVolumeAttachmentScenario-272926025 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:06:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-78f1bbf3-1f8d-4cb5-92ad-90a6a5366aab tempest-TestServerVolumeAttachmentScenario-272926025 None] Acquiring lock "cinder-87aa51af-5fa7-45c1-b744-c8c7df51c30c-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:14 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-59135776-2a31-4d07-aa9f-fab9a881d1b3 tempest-TestServerVolumeAttachmentScenario-272926025 None] Deleted volume successfully. Sep 04 16:06:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-78f1bbf3-1f8d-4cb5-92ad-90a6a5366aab tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "cinder-87aa51af-5fa7-45c1-b744-c8c7df51c30c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-59135776-2a31-4d07-aa9f-fab9a881d1b3 tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "cinder-8b7cae4d-74cf-4e12-8421-d6c0eda72380-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-78f1bbf3-1f8d-4cb5-92ad-90a6a5366aab tempest-TestServerVolumeAttachmentScenario-272926025 None] Acquiring lock "cinder-quobyte-87aa51af-5fa7-45c1-b744-c8c7df51c30c" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-78f1bbf3-1f8d-4cb5-92ad-90a6a5366aab tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "cinder-quobyte-87aa51af-5fa7-45c1-b744-c8c7df51c30c" acquired by "delete_volume" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:14 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[981f00de-51c0-4715-b794-ac07f44dea23]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-78f1bbf3-1f8d-4cb5-92ad-90a6a5366aab tempest-TestServerVolumeAttachmentScenario-272926025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87aa51af-5fa7-45c1-b744-c8c7df51c30c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:14 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87aa51af-5fa7-45c1-b744-c8c7df51c30c Sep 04 16:06:14 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:14 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-78f1bbf3-1f8d-4cb5-92ad-90a6a5366aab tempest-TestServerVolumeAttachmentScenario-272926025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87aa51af-5fa7-45c1-b744-c8c7df51c30c" returned: 0 in 0.389s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-78f1bbf3-1f8d-4cb5-92ad-90a6a5366aab tempest-TestServerVolumeAttachmentScenario-272926025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87aa51af-5fa7-45c1-b744-c8c7df51c30c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:14 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87aa51af-5fa7-45c1-b744-c8c7df51c30c Sep 04 16:06:14 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:14 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-78f1bbf3-1f8d-4cb5-92ad-90a6a5366aab tempest-TestServerVolumeAttachmentScenario-272926025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87aa51af-5fa7-45c1-b744-c8c7df51c30c" returned: 0 in 0.254s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-78f1bbf3-1f8d-4cb5-92ad-90a6a5366aab tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "cinder-quobyte-87aa51af-5fa7-45c1-b744-c8c7df51c30c" released by "delete_volume" :: held 0.687s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:14 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-78f1bbf3-1f8d-4cb5-92ad-90a6a5366aab tempest-TestServerVolumeAttachmentScenario-272926025 None] Created reservations ['2ed17ed5-7696-40e3-ae2b-c24fa95c41e9', '370a4554-fbc1-4b40-925a-5f607086899f', '7745c29d-1110-41b6-afda-d122590063a3', '3e683186-e262-4aa7-a0d5-ba8a38fbf89a'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:06:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-78f1bbf3-1f8d-4cb5-92ad-90a6a5366aab tempest-TestServerVolumeAttachmentScenario-272926025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-78f1bbf3-1f8d-4cb5-92ad-90a6a5366aab tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-78f1bbf3-1f8d-4cb5-92ad-90a6a5366aab tempest-TestServerVolumeAttachmentScenario-272926025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:06:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-78f1bbf3-1f8d-4cb5-92ad-90a6a5366aab tempest-TestServerVolumeAttachmentScenario-272926025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:06:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-78f1bbf3-1f8d-4cb5-92ad-90a6a5366aab tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-78f1bbf3-1f8d-4cb5-92ad-90a6a5366aab tempest-TestServerVolumeAttachmentScenario-272926025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:15 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:06:15 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:15 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-78f1bbf3-1f8d-4cb5-92ad-90a6a5366aab tempest-TestServerVolumeAttachmentScenario-272926025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.266s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:15 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-78f1bbf3-1f8d-4cb5-92ad-90a6a5366aab tempest-TestServerVolumeAttachmentScenario-272926025 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:06:15 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-78f1bbf3-1f8d-4cb5-92ad-90a6a5366aab tempest-TestServerVolumeAttachmentScenario-272926025 None] Deleted volume successfully. Sep 04 16:06:15 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-78f1bbf3-1f8d-4cb5-92ad-90a6a5366aab tempest-TestServerVolumeAttachmentScenario-272926025 None] Lock "cinder-87aa51af-5fa7-45c1-b744-c8c7df51c30c-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:24 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=20,cinder:UPDATE=22,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:06:25 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=26,cinder:UPDATE=16,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:06:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:06:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:06:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:06:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:34 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:06:34 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:35 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.258s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:06:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:06:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 28 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:06:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 16:06:49 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Flow 'volume_create_manager' (dd892973-df5d-4182-a3bc-e08067b0ae5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd75ba8e-f4fe-415c-8953-ed07f589e4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd75ba8e-f4fe-415c-8953-ed07f589e4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-587016208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff88bb33-71bf-4eac-bbc2-edf77fab17f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5d9afdd3c8e48e9ae4a2f87b5c0e31c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:50Z,use_quota=True,user_id='d814d294ad6a4aed9450c5c45a04c3b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936a8219-4354-42a8-8fa3-3fcee79b1e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936a8219-4354-42a8-8fa3-3fcee79b1e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77aff185-1c7d-41ae-b153-d11831e06f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77aff185-1c7d-41ae-b153-d11831e06f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff88bb33-71bf-4eac-bbc2-edf77fab17f9', 'volume_name': 'volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c00c9a0a-2f9a-46f7-a814-270d37d4e171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c00c9a0a-2f9a-46f7-a814-270d37d4e171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd6fcd1-ae83-4554-a785-ad1dcd812a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:50 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Volume ff88bb33-71bf-4eac-bbc2-edf77fab17f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9', 'volume_size': 1} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-587016208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff88bb33-71bf-4eac-bbc2-edf77fab17f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5d9afdd3c8e48e9ae4a2f87b5c0e31c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:50Z,use_quota=True,user_id='d814d294ad6a4aed9450c5c45a04c3b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Creating volume ff88bb33-71bf-4eac-bbc2-edf77fab17f9 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:06:50 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:50 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 1073741824 Sep 04 16:06:50 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:50 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 1073741824" returned: 0 in 0.485s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:50 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 Sep 04 16:06:50 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:50 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9" returned: 0 in 0.287s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd6fcd1-ae83-4554-a785-ad1dcd812a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a1ab57-867b-43e1-9f9d-939409570b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:50 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Volume volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 (ff88bb33-71bf-4eac-bbc2-edf77fab17f9): created successfully Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a1ab57-867b-43e1-9f9d-939409570b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Flow 'volume_create_manager' (dd892973-df5d-4182-a3bc-e08067b0ae5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:50 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-5e0698a6-70dd-4665-aa31-a5583e99a9e7 tempest-TestStampPattern-618052612 None] Created volume successfully. Sep 04 16:07:00 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:07:00 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:07:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-afe0de60-39ca-4815-bf88-9a93d9b74275 req-9100237f-641a-4d44-9f47-884f752889de tempest-TestStampPattern-618052612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-afe0de60-39ca-4815-bf88-9a93d9b74275 req-9100237f-641a-4d44-9f47-884f752889de tempest-TestStampPattern-618052612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:19 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c5e289-49a5-4f76-b748-4b9fef72f10a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-afe0de60-39ca-4815-bf88-9a93d9b74275 req-9100237f-641a-4d44-9f47-884f752889de tempest-TestStampPattern-618052612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:20 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 Sep 04 16:07:20 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:20 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-afe0de60-39ca-4815-bf88-9a93d9b74275 req-9100237f-641a-4d44-9f47-884f752889de tempest-TestStampPattern-618052612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9" returned: 0 in 0.354s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-afe0de60-39ca-4815-bf88-9a93d9b74275 req-9100237f-641a-4d44-9f47-884f752889de tempest-TestStampPattern-618052612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.371s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-afe0de60-39ca-4815-bf88-9a93d9b74275 req-9100237f-641a-4d44-9f47-884f752889de tempest-TestStampPattern-618052612 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46f224a4-453c-458b-b96c-aa78bdbcbc52', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 16:07:20 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-afe0de60-39ca-4815-bf88-9a93d9b74275 req-9100237f-641a-4d44-9f47-884f752889de tempest-TestStampPattern-618052612 None] attachment_update completed successfully. Sep 04 16:07:24 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-3d4f7bfd-46c7-4592-a852-b10a3c3ee2f4 req-3275a38d-ebeb-4c32-9e6b-a9252024a350 tempest-TestStampPattern-618052612 None] Terminate volume connection completed successfully. Sep 04 16:07:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-3d4f7bfd-46c7-4592-a852-b10a3c3ee2f4 req-3275a38d-ebeb-4c32-9e6b-a9252024a350 tempest-TestStampPattern-618052612 None] Deleting attachment 46f224a4-453c-458b-b96c-aa78bdbcbc52. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 16:07:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-38877f2a-e6b3-494d-ac05-6d5a03283911 tempest-TestStampPattern-618052612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-38877f2a-e6b3-494d-ac05-6d5a03283911 tempest-TestStampPattern-618052612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-38877f2a-e6b3-494d-ac05-6d5a03283911 tempest-TestStampPattern-618052612 None] Creating offline snapshot eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b of volume ff88bb33-71bf-4eac-bbc2-edf77fab17f9 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:07:25 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd028df5-b4b9-4b43-97c5-bdd04abf256c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-38877f2a-e6b3-494d-ac05-6d5a03283911 tempest-TestStampPattern-618052612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:26 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 Sep 04 16:07:26 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:26 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-38877f2a-e6b3-494d-ac05-6d5a03283911 tempest-TestStampPattern-618052612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9" returned: 0 in 0.351s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-38877f2a-e6b3-494d-ac05-6d5a03283911 tempest-TestStampPattern-618052612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:26 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b 1G Sep 04 16:07:26 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:26 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-38877f2a-e6b3-494d-ac05-6d5a03283911 tempest-TestStampPattern-618052612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b 1G" returned: 0 in 0.381s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-38877f2a-e6b3-494d-ac05-6d5a03283911 tempest-TestStampPattern-618052612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:26 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b Sep 04 16:07:26 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:26 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-38877f2a-e6b3-494d-ac05-6d5a03283911 tempest-TestStampPattern-618052612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b" returned: 0 in 0.288s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:26 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-38877f2a-e6b3-494d-ac05-6d5a03283911 tempest-TestStampPattern-618052612 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b is being set with open permissions: ugo+rw Sep 04 16:07:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-38877f2a-e6b3-494d-ac05-6d5a03283911 tempest-TestStampPattern-618052612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:27 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b Sep 04 16:07:27 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:27 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-38877f2a-e6b3-494d-ac05-6d5a03283911 tempest-TestStampPattern-618052612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b" returned: 0 in 0.236s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-38877f2a-e6b3-494d-ac05-6d5a03283911 tempest-TestStampPattern-618052612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:27 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.info Sep 04 16:07:27 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:27 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-38877f2a-e6b3-494d-ac05-6d5a03283911 tempest-TestStampPattern-618052612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.info" returned: 0 in 0.241s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:27 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-38877f2a-e6b3-494d-ac05-6d5a03283911 tempest-TestStampPattern-618052612 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.info is being set with open permissions: ugo+rw Sep 04 16:07:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-38877f2a-e6b3-494d-ac05-6d5a03283911 tempest-TestStampPattern-618052612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:27 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.info Sep 04 16:07:27 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:27 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-38877f2a-e6b3-494d-ac05-6d5a03283911 tempest-TestStampPattern-618052612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.info" returned: 0 in 0.232s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-38877f2a-e6b3-494d-ac05-6d5a03283911 tempest-TestStampPattern-618052612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.807s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:27 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-38877f2a-e6b3-494d-ac05-6d5a03283911 tempest-TestStampPattern-618052612 None] Create snapshot completed successfully Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Flow 'volume_create_manager' (e52552c2-8167-4279-9f13-0eee530e6fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d86a028-338c-4586-b705-8f94f42e1444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d86a028-338c-4586-b705-8f94f42e1444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1549782182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c92a5fd3-80b2-4a35-8394-e7c24d4f06e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5d9afdd3c8e48e9ae4a2f87b5c0e31c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:35Z,use_quota=True,user_id='d814d294ad6a4aed9450c5c45a04c3b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce0902a-12a9-4351-aea8-79d0302a751f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce0902a-12a9-4351-aea8-79d0302a751f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eddfbaf-6455-45c1-a6d1-8052129704a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eddfbaf-6455-45c1-a6d1-8052129704a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c92a5fd3-80b2-4a35-8394-e7c24d4f06e0', 'volume_name': 'volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0', 'volume_size': 1, 'snapshot_id': 'eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b'}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe716b8-5a42-457a-862d-a6547762d654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe716b8-5a42-457a-862d-a6547762d654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072f7cec-e01f-4d4d-a94d-96b511fcf802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:34 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Volume c92a5fd3-80b2-4a35-8394-e7c24d4f06e0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0', 'volume_size': 1, 'snapshot_id': 'eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b'} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Acquiring lock "cinder-quobyte-eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0" by "_create_volume_from_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Lock "cinder-quobyte-eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Creating volume c92a5fd3-80b2-4a35-8394-e7c24d4f06e0 from snapshot eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b {{(pid=87513) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Acquiring lock "cinder-quobyte-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0" by "_copy_volume_from_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Lock "cinder-quobyte-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] snapshot: eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b, volume: c92a5fd3-80b2-4a35-8394-e7c24d4f06e0, {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e54a95-1438-491d-adeb-13da9f59939e]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:34 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:07:34 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:35 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b Sep 04 16:07:35 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:35 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.260s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:07:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 28 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:07:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 16:07:35 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b" returned: 0 in 0.409s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:07:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] will copy from snapshot at /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 04 16:07:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Creating direct copy from snapshot {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 04 16:07:35 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a52e35-86a9-4eec-bbf5-4c063da73d6c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:35 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 Sep 04 16:07:35 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:35 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9" returned: 0 in 0.392s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:35 devstack cinder-volume[87513]: DEBUG cinder.utils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Path /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0 not found in is_blk_device check {{(pid=87513) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 04 16:07:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:35 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0 Sep 04 16:07:35 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:41 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0" returned: 0 in 5.327s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:41 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8b771e-baf4-4c43-a450-70c16a16c769]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:41 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 Sep 04 16:07:41 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:41 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9" returned: 0 in 0.603s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:41 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Image conversion details: src /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9, size 1024.00 MB, duration 5.33 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0 {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:07:41 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Converted 1024.00 MB image at 192.15 MB/s Sep 04 16:07:41 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0 is being set with open permissions: ugo+rw Sep 04 16:07:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:41 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0 Sep 04 16:07:41 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:41 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0" returned: 0 in 0.268s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Lock "cinder-quobyte-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0" released by "_copy_volume_from_snapshot" :: held 7.117s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Lock "cinder-quobyte-eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0" released by "_create_volume_from_snapshot" :: held 7.151s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.167s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072f7cec-e01f-4d4d-a94d-96b511fcf802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0', 'volume_size': 1, 'snapshot_id': 'eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b'}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d1f1c7-de56-4e4f-8a11-f8d777cea264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:42 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Volume volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0 (c92a5fd3-80b2-4a35-8394-e7c24d4f06e0): created successfully Sep 04 16:07:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d1f1c7-de56-4e4f-8a11-f8d777cea264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Flow 'volume_create_manager' (e52552c2-8167-4279-9f13-0eee530e6fd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:42 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-aa03e5c6-914c-4790-82a1-19c99e7e6b20 tempest-TestStampPattern-618052612 None] Created volume successfully. Sep 04 16:07:53 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=13,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:07:53 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:08:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-eaf0b1db-91fb-4af6-86aa-9bf559656ce4 req-4a868835-91e3-458b-b345-61b4fbd405b6 tempest-TestStampPattern-618052612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-eaf0b1db-91fb-4af6-86aa-9bf559656ce4 req-4a868835-91e3-458b-b345-61b4fbd405b6 tempest-TestStampPattern-618052612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:24 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d057584-24a3-4b33-8a2a-1fee7ce9fc81]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-eaf0b1db-91fb-4af6-86aa-9bf559656ce4 req-4a868835-91e3-458b-b345-61b4fbd405b6 tempest-TestStampPattern-618052612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:24 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0 Sep 04 16:08:24 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:25 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [req-eaf0b1db-91fb-4af6-86aa-9bf559656ce4 req-4a868835-91e3-458b-b345-61b4fbd405b6 tempest-TestStampPattern-618052612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0" returned: 0 in 0.344s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [req-eaf0b1db-91fb-4af6-86aa-9bf559656ce4 req-4a868835-91e3-458b-b345-61b4fbd405b6 tempest-TestStampPattern-618052612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.361s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-eaf0b1db-91fb-4af6-86aa-9bf559656ce4 req-4a868835-91e3-458b-b345-61b4fbd405b6 tempest-TestStampPattern-618052612 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e', 'name': 'volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8aa7e1c8-2478-4907-92e3-71a57b41c180', 'enforce_multipath': True} {{(pid=87513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 16:08:25 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-eaf0b1db-91fb-4af6-86aa-9bf559656ce4 req-4a868835-91e3-458b-b345-61b4fbd405b6 tempest-TestStampPattern-618052612 None] attachment_update completed successfully. Sep 04 16:08:28 devstack cinder-volume[87513]: INFO cinder.volume.manager [req-c3abe39b-b114-4e46-80fd-5293cdf06665 req-60a0bd93-bf6d-4b1c-b38a-5cbc116e352e tempest-TestStampPattern-618052612 None] Terminate volume connection completed successfully. Sep 04 16:08:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [req-c3abe39b-b114-4e46-80fd-5293cdf06665 req-60a0bd93-bf6d-4b1c-b38a-5cbc116e352e tempest-TestStampPattern-618052612 None] Deleting attachment 8aa7e1c8-2478-4907-92e3-71a57b41c180. {{(pid=87513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 16:08:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8812b14b-c700-4917-b474-1a09c2f490dd tempest-TestStampPattern-618052612 None] Acquiring lock "cinder-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8812b14b-c700-4917-b474-1a09c2f490dd tempest-TestStampPattern-618052612 None] Lock "cinder-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8812b14b-c700-4917-b474-1a09c2f490dd tempest-TestStampPattern-618052612 None] Acquiring lock "cinder-quobyte-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8812b14b-c700-4917-b474-1a09c2f490dd tempest-TestStampPattern-618052612 None] Lock "cinder-quobyte-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0" acquired by "delete_volume" :: waited 0.022s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:32 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42bf715-8597-4d98-ad16-ae83feb606d8]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8812b14b-c700-4917-b474-1a09c2f490dd tempest-TestStampPattern-618052612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:32 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0 Sep 04 16:08:32 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:32 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8812b14b-c700-4917-b474-1a09c2f490dd tempest-TestStampPattern-618052612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0" returned: 0 in 0.352s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8812b14b-c700-4917-b474-1a09c2f490dd tempest-TestStampPattern-618052612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:32 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0 Sep 04 16:08:32 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:32 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8812b14b-c700-4917-b474-1a09c2f490dd tempest-TestStampPattern-618052612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0" returned: 0 in 0.236s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8812b14b-c700-4917-b474-1a09c2f490dd tempest-TestStampPattern-618052612 None] Lock "cinder-quobyte-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0" released by "delete_volume" :: held 0.631s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:32 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-8812b14b-c700-4917-b474-1a09c2f490dd tempest-TestStampPattern-618052612 None] Created reservations ['9440eb84-761b-46a1-b7be-93d6303fe382', '7b9ce435-55cc-4e1d-a36b-6d2a6f510849', '4170deed-292b-446f-88eb-7c3b8af36f8d', 'a2f3896e-1908-4a5e-b856-42fc5c0503af'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:08:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8812b14b-c700-4917-b474-1a09c2f490dd tempest-TestStampPattern-618052612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8812b14b-c700-4917-b474-1a09c2f490dd tempest-TestStampPattern-618052612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8812b14b-c700-4917-b474-1a09c2f490dd tempest-TestStampPattern-618052612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:08:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8812b14b-c700-4917-b474-1a09c2f490dd tempest-TestStampPattern-618052612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:08:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8812b14b-c700-4917-b474-1a09c2f490dd tempest-TestStampPattern-618052612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8812b14b-c700-4917-b474-1a09c2f490dd tempest-TestStampPattern-618052612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:33 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:08:33 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:33 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8812b14b-c700-4917-b474-1a09c2f490dd tempest-TestStampPattern-618052612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.238s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:33 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-8812b14b-c700-4917-b474-1a09c2f490dd tempest-TestStampPattern-618052612 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:08:33 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-8812b14b-c700-4917-b474-1a09c2f490dd tempest-TestStampPattern-618052612 None] Deleted volume successfully. Sep 04 16:08:33 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-8812b14b-c700-4917-b474-1a09c2f490dd tempest-TestStampPattern-618052612 None] Lock "cinder-c92a5fd3-80b2-4a35-8394-e7c24d4f06e0-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:33 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] Acquiring lock "cinder-eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:33 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] Lock "cinder-eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:33 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] Acquiring lock "cinder-quobyte-ff88bb33-71bf-4eac-bbc2-edf77fab17f9" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:33 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] Lock "cinder-quobyte-ff88bb33-71bf-4eac-bbc2-edf77fab17f9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:33 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] Acquiring lock "cinder-quobyte-eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:33 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] Lock "cinder-quobyte-eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] Deleting offline snapshot eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b of volume ff88bb33-71bf-4eac-bbc2-edf77fab17f9 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:08:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] snapshot_file for this snap is: volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:08:33 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a6e6aa-ebac-4994-9e46-6a9452d27ffb]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:33 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b Sep 04 16:08:33 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:34 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b" returned: 0 in 0.354s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:08:34 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b56826-e480-400e-8cad-fc967b22b3d6]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:34 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 Sep 04 16:08:34 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:34 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9" returned: 0 in 0.361s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:34 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b Sep 04 16:08:34 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:34 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b" returned: 0 in 0.313s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:34 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b Sep 04 16:08:34 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:08:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:08:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:08:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:34 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:08:34 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:35 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9.eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b" returned: 0 in 0.230s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] Lock "cinder-quobyte-eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b" released by "_delete_snapshot" :: held 1.346s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] Lock "cinder-quobyte-ff88bb33-71bf-4eac-bbc2-edf77fab17f9" released by "delete_snapshot" :: held 1.366s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:35 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] Created reservations ['d1da2b52-39c7-4bf5-bdf2-5a203fca4d7b', '12f96eb0-2032-42ac-999a-45c447602bf6', '62a28c1f-716e-4688-b39e-29438894e30a', 'd2bebf2e-11c7-4c71-98e2-4819f132f5a8'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:08:35 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] Delete snapshot completed successfully. Sep 04 16:08:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-01266751-7642-42d1-a78b-d7244cd960ee tempest-TestStampPattern-618052612 None] Lock "cinder-eeb3b6e0-30bb-438a-9ce6-7cc4fe97f73b-delete_snapshot" released by "delete_snapshot" :: held 1.503s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:35 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.251s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:08:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:08:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 28 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:08:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 16:08:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e122fc2b-85be-4e6c-9e5d-a956eba8d570 tempest-TestStampPattern-618052612 None] Acquiring lock "cinder-ff88bb33-71bf-4eac-bbc2-edf77fab17f9-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e122fc2b-85be-4e6c-9e5d-a956eba8d570 tempest-TestStampPattern-618052612 None] Lock "cinder-ff88bb33-71bf-4eac-bbc2-edf77fab17f9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e122fc2b-85be-4e6c-9e5d-a956eba8d570 tempest-TestStampPattern-618052612 None] Acquiring lock "cinder-quobyte-ff88bb33-71bf-4eac-bbc2-edf77fab17f9" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e122fc2b-85be-4e6c-9e5d-a956eba8d570 tempest-TestStampPattern-618052612 None] Lock "cinder-quobyte-ff88bb33-71bf-4eac-bbc2-edf77fab17f9" acquired by "delete_volume" :: waited 0.012s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:39 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3498c6-b48a-4783-8267-d7d715fe2832]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e122fc2b-85be-4e6c-9e5d-a956eba8d570 tempest-TestStampPattern-618052612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:39 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 Sep 04 16:08:39 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:39 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e122fc2b-85be-4e6c-9e5d-a956eba8d570 tempest-TestStampPattern-618052612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9" returned: 0 in 0.349s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e122fc2b-85be-4e6c-9e5d-a956eba8d570 tempest-TestStampPattern-618052612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:39 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9 Sep 04 16:08:39 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:39 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e122fc2b-85be-4e6c-9e5d-a956eba8d570 tempest-TestStampPattern-618052612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ff88bb33-71bf-4eac-bbc2-edf77fab17f9" returned: 0 in 0.231s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e122fc2b-85be-4e6c-9e5d-a956eba8d570 tempest-TestStampPattern-618052612 None] Lock "cinder-quobyte-ff88bb33-71bf-4eac-bbc2-edf77fab17f9" released by "delete_volume" :: held 0.638s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:39 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-e122fc2b-85be-4e6c-9e5d-a956eba8d570 tempest-TestStampPattern-618052612 None] Created reservations ['caccbbca-9560-4156-9209-874673650d38', '0a459965-5462-4e2d-8c37-d13d78ad4ea6', '7afa5580-1b8f-4e66-bfe4-9f51d0e23960', '53067e2b-e430-438d-927c-73460adf2ea5'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:08:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e122fc2b-85be-4e6c-9e5d-a956eba8d570 tempest-TestStampPattern-618052612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e122fc2b-85be-4e6c-9e5d-a956eba8d570 tempest-TestStampPattern-618052612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e122fc2b-85be-4e6c-9e5d-a956eba8d570 tempest-TestStampPattern-618052612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:08:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e122fc2b-85be-4e6c-9e5d-a956eba8d570 tempest-TestStampPattern-618052612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:08:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e122fc2b-85be-4e6c-9e5d-a956eba8d570 tempest-TestStampPattern-618052612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e122fc2b-85be-4e6c-9e5d-a956eba8d570 tempest-TestStampPattern-618052612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:40 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:08:40 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:40 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e122fc2b-85be-4e6c-9e5d-a956eba8d570 tempest-TestStampPattern-618052612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.229s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:40 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-e122fc2b-85be-4e6c-9e5d-a956eba8d570 tempest-TestStampPattern-618052612 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:08:40 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e122fc2b-85be-4e6c-9e5d-a956eba8d570 tempest-TestStampPattern-618052612 None] Deleted volume successfully. Sep 04 16:08:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e122fc2b-85be-4e6c-9e5d-a956eba8d570 tempest-TestStampPattern-618052612 None] Lock "cinder-ff88bb33-71bf-4eac-bbc2-edf77fab17f9-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:49 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=18,cinder:UPDATE=26,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:08:50 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=26,cinder:UPDATE=20,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Flow 'volume_create_manager' (e0d6fbf5-5eaf-4360-a6c5-5e3cd80c2d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39598c49-454d-4074-aff1-af89ea263873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39598c49-454d-4074-aff1-af89ea263873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1424810284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ea755a-84b0-4b2d-bde3-2407be04d562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfc402c8b3f41458cac1277d52dc951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:51Z,use_quota=True,user_id='5f822dfe2b9b4589915438ceabbcf478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5441799c-ae09-48d3-ae2b-cdbb2d78c8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5441799c-ae09-48d3-ae2b-cdbb2d78c8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718ab6fa-ea9d-4d09-b901-a96527bd7d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718ab6fa-ea9d-4d09-b901-a96527bd7d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ea755a-84b0-4b2d-bde3-2407be04d562', 'volume_name': 'volume-c0ea755a-84b0-4b2d-bde3-2407be04d562', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0bdf3f-c28c-4f40-b8e3-1c2958bbe5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0bdf3f-c28c-4f40-b8e3-1c2958bbe5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8da0bd-64fb-4cc8-bf00-39dd83ba735c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:51 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Volume c0ea755a-84b0-4b2d-bde3-2407be04d562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ea755a-84b0-4b2d-bde3-2407be04d562', 'volume_size': 1} Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1424810284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ea755a-84b0-4b2d-bde3-2407be04d562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfc402c8b3f41458cac1277d52dc951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:51Z,use_quota=True,user_id='5f822dfe2b9b4589915438ceabbcf478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Creating volume c0ea755a-84b0-4b2d-bde3-2407be04d562 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:08:51 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:51 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562 1073741824 Sep 04 16:08:51 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:51 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562 1073741824" returned: 0 in 0.416s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:52 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562 Sep 04 16:08:52 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:52 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562" returned: 0 in 0.257s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:08:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8da0bd-64fb-4cc8-bf00-39dd83ba735c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ea755a-84b0-4b2d-bde3-2407be04d562', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0a5d58-f446-4cd2-97b3-18f771fb2ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:52 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Volume volume-c0ea755a-84b0-4b2d-bde3-2407be04d562 (c0ea755a-84b0-4b2d-bde3-2407be04d562): created successfully Sep 04 16:08:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0a5d58-f446-4cd2-97b3-18f771fb2ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Flow 'volume_create_manager' (e0d6fbf5-5eaf-4360-a6c5-5e3cd80c2d6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:52 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b4f22be0-1c1a-48c5-ad24-0dcbca980947 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Created volume successfully. Sep 04 16:08:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8bc1e9e8-78d3-46f6-8408-ec6537b5b098 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8bc1e9e8-78d3-46f6-8408-ec6537b5b098 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-8bc1e9e8-78d3-46f6-8408-ec6537b5b098 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Creating offline snapshot ebc5b08b-8725-4262-86b4-b89caf39a031 of volume c0ea755a-84b0-4b2d-bde3-2407be04d562 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:08:52 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa3494c-8fc7-40d5-ba5e-d81bd2b5c5ba]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8bc1e9e8-78d3-46f6-8408-ec6537b5b098 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:52 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562 Sep 04 16:08:52 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:53 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8bc1e9e8-78d3-46f6-8408-ec6537b5b098 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562" returned: 0 in 0.366s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8bc1e9e8-78d3-46f6-8408-ec6537b5b098 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.ebc5b08b-8725-4262-86b4-b89caf39a031 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:53 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.ebc5b08b-8725-4262-86b4-b89caf39a031 1G Sep 04 16:08:53 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:53 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8bc1e9e8-78d3-46f6-8408-ec6537b5b098 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.ebc5b08b-8725-4262-86b4-b89caf39a031 1G" returned: 0 in 0.398s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8bc1e9e8-78d3-46f6-8408-ec6537b5b098 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0ea755a-84b0-4b2d-bde3-2407be04d562 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.ebc5b08b-8725-4262-86b4-b89caf39a031 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:53 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0ea755a-84b0-4b2d-bde3-2407be04d562 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.ebc5b08b-8725-4262-86b4-b89caf39a031 Sep 04 16:08:53 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:53 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8bc1e9e8-78d3-46f6-8408-ec6537b5b098 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0ea755a-84b0-4b2d-bde3-2407be04d562 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.ebc5b08b-8725-4262-86b4-b89caf39a031" returned: 0 in 0.284s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:53 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-8bc1e9e8-78d3-46f6-8408-ec6537b5b098 tempest-CreateVolumesFromSnapshotTest-1986151947 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.ebc5b08b-8725-4262-86b4-b89caf39a031 is being set with open permissions: ugo+rw Sep 04 16:08:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8bc1e9e8-78d3-46f6-8408-ec6537b5b098 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.ebc5b08b-8725-4262-86b4-b89caf39a031 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:53 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.ebc5b08b-8725-4262-86b4-b89caf39a031 Sep 04 16:08:53 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:53 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8bc1e9e8-78d3-46f6-8408-ec6537b5b098 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.ebc5b08b-8725-4262-86b4-b89caf39a031" returned: 0 in 0.235s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8bc1e9e8-78d3-46f6-8408-ec6537b5b098 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:54 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.info Sep 04 16:08:54 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:54 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8bc1e9e8-78d3-46f6-8408-ec6537b5b098 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.info" returned: 0 in 0.239s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:54 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-8bc1e9e8-78d3-46f6-8408-ec6537b5b098 tempest-CreateVolumesFromSnapshotTest-1986151947 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.info is being set with open permissions: ugo+rw Sep 04 16:08:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8bc1e9e8-78d3-46f6-8408-ec6537b5b098 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:54 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.info Sep 04 16:08:54 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:54 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8bc1e9e8-78d3-46f6-8408-ec6537b5b098 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.info" returned: 0 in 0.232s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8bc1e9e8-78d3-46f6-8408-ec6537b5b098 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.837s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:54 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-8bc1e9e8-78d3-46f6-8408-ec6537b5b098 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Create snapshot completed successfully Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Flow 'volume_create_manager' (072d31fb-7381-48db-b039-e292db9199d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee46bdb-e300-4302-97b8-146e8d1243d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee46bdb-e300-4302-97b8-146e8d1243d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-64524652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9a251b-792d-47f1-ac70-bda63b98c654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfc402c8b3f41458cac1277d52dc951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:55Z,use_quota=True,user_id='5f822dfe2b9b4589915438ceabbcf478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ad2e6b-99d6-4f5d-a3fe-8b002a91cfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ad2e6b-99d6-4f5d-a3fe-8b002a91cfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd791768-3b9a-4661-8e32-cb904141678b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd791768-3b9a-4661-8e32-cb904141678b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d9a251b-792d-47f1-ac70-bda63b98c654', 'volume_name': 'volume-6d9a251b-792d-47f1-ac70-bda63b98c654', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36d1b50-f61c-4d5f-830e-2607463177fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36d1b50-f61c-4d5f-830e-2607463177fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86de96b3-0db2-4b00-898d-fd51d2639f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:55 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Volume 6d9a251b-792d-47f1-ac70-bda63b98c654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d9a251b-792d-47f1-ac70-bda63b98c654', 'volume_size': 1} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-64524652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9a251b-792d-47f1-ac70-bda63b98c654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfc402c8b3f41458cac1277d52dc951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:55Z,use_quota=True,user_id='5f822dfe2b9b4589915438ceabbcf478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Creating volume 6d9a251b-792d-47f1-ac70-bda63b98c654 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:08:55 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d9a251b-792d-47f1-ac70-bda63b98c654 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:55 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d9a251b-792d-47f1-ac70-bda63b98c654 1073741824 Sep 04 16:08:55 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Flow 'volume_create_manager' (b26e1854-38dc-4d37-bc15-3243bcb03be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (294d485b-b79d-4317-98e5-3dcf5d8b19e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (294d485b-b79d-4317-98e5-3dcf5d8b19e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1908267554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa5d4e2-d9f3-4675-b71d-b050609c05a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfc402c8b3f41458cac1277d52dc951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:55Z,use_quota=True,user_id='5f822dfe2b9b4589915438ceabbcf478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed28057-552c-4fed-9f25-8a019336418b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed28057-552c-4fed-9f25-8a019336418b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0444a2d8-65ba-43ce-98e5-792a484da8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0444a2d8-65ba-43ce-98e5-792a484da8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaa5d4e2-d9f3-4675-b71d-b050609c05a8', 'volume_name': 'volume-aaa5d4e2-d9f3-4675-b71d-b050609c05a8', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585d9969-2676-4381-b4ff-98e8b37ac539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585d9969-2676-4381-b4ff-98e8b37ac539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17006e81-ca1f-440e-a6fa-f99c7563e0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:55 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Volume aaa5d4e2-d9f3-4675-b71d-b050609c05a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaa5d4e2-d9f3-4675-b71d-b050609c05a8', 'volume_size': 1} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:55 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d9a251b-792d-47f1-ac70-bda63b98c654 1073741824" returned: 0 in 0.522s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d9a251b-792d-47f1-ac70-bda63b98c654 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:55 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d9a251b-792d-47f1-ac70-bda63b98c654 Sep 04 16:08:55 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Flow 'volume_create_manager' (4fa6306f-b60e-412e-9483-469a4647f33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72a546b-1d62-4952-a000-a6d643b3c6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72a546b-1d62-4952-a000-a6d643b3c6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647724386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfc402c8b3f41458cac1277d52dc951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:56Z,use_quota=True,user_id='5f822dfe2b9b4589915438ceabbcf478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a37cc4-e766-4bde-9560-af593487be38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a37cc4-e766-4bde-9560-af593487be38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb1593d-5927-4197-98c7-5f7e001dd32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb1593d-5927-4197-98c7-5f7e001dd32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4', 'volume_name': 'volume-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866ba1e5-c934-4ffc-837e-8355b1c90473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866ba1e5-c934-4ffc-837e-8355b1c90473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029a5bd1-d3f6-44c7-83cf-cd60dec9f6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:56 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Volume 3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4', 'volume_size': 1} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:56 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d9a251b-792d-47f1-ac70-bda63b98c654" returned: 0 in 0.287s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.548s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1908267554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa5d4e2-d9f3-4675-b71d-b050609c05a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfc402c8b3f41458cac1277d52dc951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:55Z,use_quota=True,user_id='5f822dfe2b9b4589915438ceabbcf478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Creating volume aaa5d4e2-d9f3-4675-b71d-b050609c05a8 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:08:56 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-aaa5d4e2-d9f3-4675-b71d-b050609c05a8 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86de96b3-0db2-4b00-898d-fd51d2639f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d9a251b-792d-47f1-ac70-bda63b98c654', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a4b45f-87a4-41fb-9c8a-6545194f1372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:56 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-aaa5d4e2-d9f3-4675-b71d-b050609c05a8 1073741824 Sep 04 16:08:56 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:56 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Volume volume-6d9a251b-792d-47f1-ac70-bda63b98c654 (6d9a251b-792d-47f1-ac70-bda63b98c654): created successfully Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a4b45f-87a4-41fb-9c8a-6545194f1372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Flow 'volume_create_manager' (072d31fb-7381-48db-b039-e292db9199d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:56 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-aa215023-63cd-422c-b681-a007065022d9 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Created volume successfully. Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Flow 'volume_create_manager' (b14f7525-5357-4264-8173-d2fefe6a50e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ed11e9-dbab-4268-879a-0cd02bccebff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ed11e9-dbab-4268-879a-0cd02bccebff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1123568262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c568f01-57e8-4df1-8477-09e95a84d7ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfc402c8b3f41458cac1277d52dc951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:56Z,use_quota=True,user_id='5f822dfe2b9b4589915438ceabbcf478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bfd0011-34be-44d5-a212-86c5394a7c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bfd0011-34be-44d5-a212-86c5394a7c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7da11a-ff84-43dc-95cd-df392054a24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7da11a-ff84-43dc-95cd-df392054a24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c568f01-57e8-4df1-8477-09e95a84d7ae', 'volume_name': 'volume-7c568f01-57e8-4df1-8477-09e95a84d7ae', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78752c9d-78f5-4f21-b889-987bd49fe9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78752c9d-78f5-4f21-b889-987bd49fe9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9122a53f-73d5-435d-91fd-3e9b3dcdb384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:56 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Volume 7c568f01-57e8-4df1-8477-09e95a84d7ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c568f01-57e8-4df1-8477-09e95a84d7ae', 'volume_size': 1} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Flow 'volume_create_manager' (53174222-267c-4a1b-98d8-28d1eb12c2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1256b96f-a70d-44a4-8e9f-7291e41abc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1256b96f-a70d-44a4-8e9f-7291e41abc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-21652552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92976af4-d804-40e4-b104-c73b4edfaa01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfc402c8b3f41458cac1277d52dc951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:57Z,use_quota=True,user_id='5f822dfe2b9b4589915438ceabbcf478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:56 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0664284b-84f2-40b8-87f0-726ed146d4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0664284b-84f2-40b8-87f0-726ed146d4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209347b6-ccd5-457c-90a3-fec235e711c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209347b6-ccd5-457c-90a3-fec235e711c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92976af4-d804-40e4-b104-c73b4edfaa01', 'volume_name': 'volume-92976af4-d804-40e4-b104-c73b4edfaa01', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55ee3c6-4561-407c-922e-e92aa0073eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55ee3c6-4561-407c-922e-e92aa0073eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d3ee068-d1f0-4849-aee3-c6b194fc3369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:56 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Volume 92976af4-d804-40e4-b104-c73b4edfaa01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92976af4-d804-40e4-b104-c73b4edfaa01', 'volume_size': 1} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-aaa5d4e2-d9f3-4675-b71d-b050609c05a8 1073741824" returned: 0 in 0.594s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-aaa5d4e2-d9f3-4675-b71d-b050609c05a8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:56 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-aaa5d4e2-d9f3-4675-b71d-b050609c05a8 Sep 04 16:08:56 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:57 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-aaa5d4e2-d9f3-4675-b71d-b050609c05a8" returned: 0 in 0.233s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.022s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647724386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfc402c8b3f41458cac1277d52dc951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:56Z,use_quota=True,user_id='5f822dfe2b9b4589915438ceabbcf478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Creating volume 3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:08:57 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17006e81-ca1f-440e-a6fa-f99c7563e0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaa5d4e2-d9f3-4675-b71d-b050609c05a8', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fe7a6d6-d28b-4091-a857-73dad6e4a81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:57 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4 1073741824 Sep 04 16:08:57 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:57 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Volume volume-aaa5d4e2-d9f3-4675-b71d-b050609c05a8 (aaa5d4e2-d9f3-4675-b71d-b050609c05a8): created successfully Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fe7a6d6-d28b-4091-a857-73dad6e4a81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Flow 'volume_create_manager' (b26e1854-38dc-4d37-bc15-3243bcb03be6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:57 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e940933d-c7d4-44e2-9cd3-f7dc0ecb4818 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Created volume successfully. Sep 04 16:08:57 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4 1073741824" returned: 0 in 0.436s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:57 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4 Sep 04 16:08:57 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:57 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4" returned: 0 in 0.249s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.320s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1123568262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c568f01-57e8-4df1-8477-09e95a84d7ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfc402c8b3f41458cac1277d52dc951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:56Z,use_quota=True,user_id='5f822dfe2b9b4589915438ceabbcf478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Creating volume 7c568f01-57e8-4df1-8477-09e95a84d7ae {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:08:57 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c568f01-57e8-4df1-8477-09e95a84d7ae 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029a5bd1-d3f6-44c7-83cf-cd60dec9f6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:57 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c568f01-57e8-4df1-8477-09e95a84d7ae 1073741824 Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c801f8-2980-4823-880e-e129b2a7c70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:57 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:57 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Volume volume-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4 (3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4): created successfully Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c801f8-2980-4823-880e-e129b2a7c70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:57 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Flow 'volume_create_manager' (4fa6306f-b60e-412e-9483-469a4647f33f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:57 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e69eb0ff-bfa1-4c92-837a-4ae470987949 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Created volume successfully. Sep 04 16:08:58 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c568f01-57e8-4df1-8477-09e95a84d7ae 1073741824" returned: 0 in 0.405s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c568f01-57e8-4df1-8477-09e95a84d7ae {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:58 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c568f01-57e8-4df1-8477-09e95a84d7ae Sep 04 16:08:58 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:58 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c568f01-57e8-4df1-8477-09e95a84d7ae" returned: 0 in 0.239s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:08:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.678s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-21652552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92976af4-d804-40e4-b104-c73b4edfaa01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfc402c8b3f41458cac1277d52dc951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:57Z,use_quota=True,user_id='5f822dfe2b9b4589915438ceabbcf478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:08:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Creating volume 92976af4-d804-40e4-b104-c73b4edfaa01 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:08:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:08:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:08:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:08:58 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:08:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-92976af4-d804-40e4-b104-c73b4edfaa01 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9122a53f-73d5-435d-91fd-3e9b3dcdb384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c568f01-57e8-4df1-8477-09e95a84d7ae', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:58 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-92976af4-d804-40e4-b104-c73b4edfaa01 1073741824 Sep 04 16:08:58 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f23846-8177-4f88-970d-f4f54bf1a80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:58 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Volume volume-7c568f01-57e8-4df1-8477-09e95a84d7ae (7c568f01-57e8-4df1-8477-09e95a84d7ae): created successfully Sep 04 16:08:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f23846-8177-4f88-970d-f4f54bf1a80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Flow 'volume_create_manager' (b14f7525-5357-4264-8173-d2fefe6a50e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:58 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-875aa161-8b75-45af-b45c-720d14f0d464 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Created volume successfully. Sep 04 16:08:58 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-92976af4-d804-40e4-b104-c73b4edfaa01 1073741824" returned: 0 in 0.438s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-92976af4-d804-40e4-b104-c73b4edfaa01 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:58 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-92976af4-d804-40e4-b104-c73b4edfaa01 Sep 04 16:08:58 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:59 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-92976af4-d804-40e4-b104-c73b4edfaa01" returned: 0 in 0.228s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:08:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d3ee068-d1f0-4849-aee3-c6b194fc3369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92976af4-d804-40e4-b104-c73b4edfaa01', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f298998-4e0a-436d-a18c-23c44acc6128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:59 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Volume volume-92976af4-d804-40e4-b104-c73b4edfaa01 (92976af4-d804-40e4-b104-c73b4edfaa01): created successfully Sep 04 16:08:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f298998-4e0a-436d-a18c-23c44acc6128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Flow 'volume_create_manager' (53174222-267c-4a1b-98d8-28d1eb12c2de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:59 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-724ef8bc-627b-4bba-89a1-9bdeda50edb0 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Created volume successfully. Sep 04 16:09:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3fcec3a9-eb64-4a55-a9c4-157d63f7444c tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "cinder-92976af4-d804-40e4-b104-c73b4edfaa01-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3fcec3a9-eb64-4a55-a9c4-157d63f7444c tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-92976af4-d804-40e4-b104-c73b4edfaa01-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3fcec3a9-eb64-4a55-a9c4-157d63f7444c tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "cinder-quobyte-92976af4-d804-40e4-b104-c73b4edfaa01" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3fcec3a9-eb64-4a55-a9c4-157d63f7444c tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-quobyte-92976af4-d804-40e4-b104-c73b4edfaa01" acquired by "delete_volume" :: waited 0.013s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:00 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bf2576-d3f2-4937-bbd1-58dc30a4bcef]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3fcec3a9-eb64-4a55-a9c4-157d63f7444c tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-92976af4-d804-40e4-b104-c73b4edfaa01 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:00 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-92976af4-d804-40e4-b104-c73b4edfaa01 Sep 04 16:09:00 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:00 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3fcec3a9-eb64-4a55-a9c4-157d63f7444c tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-92976af4-d804-40e4-b104-c73b4edfaa01" returned: 0 in 0.344s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3fcec3a9-eb64-4a55-a9c4-157d63f7444c tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-92976af4-d804-40e4-b104-c73b4edfaa01 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:00 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-92976af4-d804-40e4-b104-c73b4edfaa01 Sep 04 16:09:00 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:00 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3fcec3a9-eb64-4a55-a9c4-157d63f7444c tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-92976af4-d804-40e4-b104-c73b4edfaa01" returned: 0 in 0.243s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3fcec3a9-eb64-4a55-a9c4-157d63f7444c tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-quobyte-92976af4-d804-40e4-b104-c73b4edfaa01" released by "delete_volume" :: held 0.623s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:00 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-3fcec3a9-eb64-4a55-a9c4-157d63f7444c tempest-CreateVolumesFromSnapshotTest-1986151947 None] Created reservations ['737797ba-3706-4ef3-9aee-17cca75a600b', '7e25c731-b101-41ea-93b4-46bd8b012ae8', '77e353e8-7e4f-44e9-870b-eefb53e67b33', '20c5d596-4e23-45fe-a59f-5ebb7df559ed'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3fcec3a9-eb64-4a55-a9c4-157d63f7444c tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3fcec3a9-eb64-4a55-a9c4-157d63f7444c tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:00 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3fcec3a9-eb64-4a55-a9c4-157d63f7444c tempest-CreateVolumesFromSnapshotTest-1986151947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:00 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3fcec3a9-eb64-4a55-a9c4-157d63f7444c tempest-CreateVolumesFromSnapshotTest-1986151947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3fcec3a9-eb64-4a55-a9c4-157d63f7444c tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3fcec3a9-eb64-4a55-a9c4-157d63f7444c tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:00 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:00 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:01 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3fcec3a9-eb64-4a55-a9c4-157d63f7444c tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.237s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:01 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-3fcec3a9-eb64-4a55-a9c4-157d63f7444c tempest-CreateVolumesFromSnapshotTest-1986151947 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:01 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-3fcec3a9-eb64-4a55-a9c4-157d63f7444c tempest-CreateVolumesFromSnapshotTest-1986151947 None] Deleted volume successfully. Sep 04 16:09:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3fcec3a9-eb64-4a55-a9c4-157d63f7444c tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-92976af4-d804-40e4-b104-c73b4edfaa01-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-09e4a761-2033-41ed-9975-510e23d97946 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "cinder-7c568f01-57e8-4df1-8477-09e95a84d7ae-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-09e4a761-2033-41ed-9975-510e23d97946 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-7c568f01-57e8-4df1-8477-09e95a84d7ae-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-09e4a761-2033-41ed-9975-510e23d97946 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "cinder-quobyte-7c568f01-57e8-4df1-8477-09e95a84d7ae" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-09e4a761-2033-41ed-9975-510e23d97946 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-quobyte-7c568f01-57e8-4df1-8477-09e95a84d7ae" acquired by "delete_volume" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:01 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97fd3dc-f9cb-4ca5-b052-10b31bf20f2f]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-09e4a761-2033-41ed-9975-510e23d97946 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c568f01-57e8-4df1-8477-09e95a84d7ae {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:01 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c568f01-57e8-4df1-8477-09e95a84d7ae Sep 04 16:09:01 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:01 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-09e4a761-2033-41ed-9975-510e23d97946 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c568f01-57e8-4df1-8477-09e95a84d7ae" returned: 0 in 0.332s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-09e4a761-2033-41ed-9975-510e23d97946 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c568f01-57e8-4df1-8477-09e95a84d7ae {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:01 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c568f01-57e8-4df1-8477-09e95a84d7ae Sep 04 16:09:01 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:01 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-09e4a761-2033-41ed-9975-510e23d97946 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-7c568f01-57e8-4df1-8477-09e95a84d7ae" returned: 0 in 0.234s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-09e4a761-2033-41ed-9975-510e23d97946 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-quobyte-7c568f01-57e8-4df1-8477-09e95a84d7ae" released by "delete_volume" :: held 0.602s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:01 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-09e4a761-2033-41ed-9975-510e23d97946 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Created reservations ['953f22ed-5eb3-4ccf-8649-8cd17db7dc7f', 'a5318f47-16cc-4815-a73e-2a827ec79dab', '1ffa17c0-0fbc-409f-ac2c-d0433c8676d6', '98d47fcd-c058-43ae-987b-fad2615ee21a'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-09e4a761-2033-41ed-9975-510e23d97946 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-09e4a761-2033-41ed-9975-510e23d97946 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-09e4a761-2033-41ed-9975-510e23d97946 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-09e4a761-2033-41ed-9975-510e23d97946 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-09e4a761-2033-41ed-9975-510e23d97946 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-09e4a761-2033-41ed-9975-510e23d97946 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:02 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:02 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:02 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-09e4a761-2033-41ed-9975-510e23d97946 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.229s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:02 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-09e4a761-2033-41ed-9975-510e23d97946 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:02 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-09e4a761-2033-41ed-9975-510e23d97946 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Deleted volume successfully. Sep 04 16:09:02 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-09e4a761-2033-41ed-9975-510e23d97946 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-7c568f01-57e8-4df1-8477-09e95a84d7ae-delete_volume" released by "delete_volume" :: held 1.011s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:02 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-242ec1d0-6b08-4325-8183-5320379d8da4 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "cinder-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:02 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-242ec1d0-6b08-4325-8183-5320379d8da4 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:02 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-242ec1d0-6b08-4325-8183-5320379d8da4 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "cinder-quobyte-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:02 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-242ec1d0-6b08-4325-8183-5320379d8da4 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-quobyte-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4" acquired by "delete_volume" :: waited 0.014s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:02 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d955e5-3dbe-4a49-a853-6c7f2e1fdda3]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-242ec1d0-6b08-4325-8183-5320379d8da4 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:02 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4 Sep 04 16:09:02 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:02 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-242ec1d0-6b08-4325-8183-5320379d8da4 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4" returned: 0 in 0.332s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-242ec1d0-6b08-4325-8183-5320379d8da4 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:02 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4 Sep 04 16:09:02 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:03 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-242ec1d0-6b08-4325-8183-5320379d8da4 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4" returned: 0 in 0.227s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-242ec1d0-6b08-4325-8183-5320379d8da4 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-quobyte-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4" released by "delete_volume" :: held 0.596s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:03 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-242ec1d0-6b08-4325-8183-5320379d8da4 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Created reservations ['b2db7420-4ac5-4af6-9d9f-bb7d19bd276b', '0f8af750-6dd6-43b6-b58b-b035a7b1a78b', 'd93abe13-9c5b-4247-bee9-86505efdd02a', '387b2687-85db-4ecc-947b-78aabc60284b'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-242ec1d0-6b08-4325-8183-5320379d8da4 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-242ec1d0-6b08-4325-8183-5320379d8da4 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-242ec1d0-6b08-4325-8183-5320379d8da4 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-242ec1d0-6b08-4325-8183-5320379d8da4 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-242ec1d0-6b08-4325-8183-5320379d8da4 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-242ec1d0-6b08-4325-8183-5320379d8da4 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:03 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:03 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:03 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-242ec1d0-6b08-4325-8183-5320379d8da4 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.234s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:03 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-242ec1d0-6b08-4325-8183-5320379d8da4 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:03 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-242ec1d0-6b08-4325-8183-5320379d8da4 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Deleted volume successfully. Sep 04 16:09:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-242ec1d0-6b08-4325-8183-5320379d8da4 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-3dcc9ce6-29c1-4ce2-a1be-06ef5e4f76f4-delete_volume" released by "delete_volume" :: held 1.029s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3741324b-9d20-4a89-b9ba-190da5bd4d55 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "cinder-aaa5d4e2-d9f3-4675-b71d-b050609c05a8-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3741324b-9d20-4a89-b9ba-190da5bd4d55 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-aaa5d4e2-d9f3-4675-b71d-b050609c05a8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3741324b-9d20-4a89-b9ba-190da5bd4d55 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "cinder-quobyte-aaa5d4e2-d9f3-4675-b71d-b050609c05a8" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3741324b-9d20-4a89-b9ba-190da5bd4d55 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-quobyte-aaa5d4e2-d9f3-4675-b71d-b050609c05a8" acquired by "delete_volume" :: waited 0.014s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:03 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6115df-7985-42c8-a1b1-321825b05fa0]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3741324b-9d20-4a89-b9ba-190da5bd4d55 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-aaa5d4e2-d9f3-4675-b71d-b050609c05a8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:03 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-aaa5d4e2-d9f3-4675-b71d-b050609c05a8 Sep 04 16:09:03 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:03 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3741324b-9d20-4a89-b9ba-190da5bd4d55 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-aaa5d4e2-d9f3-4675-b71d-b050609c05a8" returned: 0 in 0.337s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3741324b-9d20-4a89-b9ba-190da5bd4d55 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-aaa5d4e2-d9f3-4675-b71d-b050609c05a8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:04 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-aaa5d4e2-d9f3-4675-b71d-b050609c05a8 Sep 04 16:09:04 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:04 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3741324b-9d20-4a89-b9ba-190da5bd4d55 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-aaa5d4e2-d9f3-4675-b71d-b050609c05a8" returned: 0 in 0.232s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:04 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3741324b-9d20-4a89-b9ba-190da5bd4d55 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-quobyte-aaa5d4e2-d9f3-4675-b71d-b050609c05a8" released by "delete_volume" :: held 0.604s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:04 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-3741324b-9d20-4a89-b9ba-190da5bd4d55 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Created reservations ['af58f2f6-1b58-4bed-afbf-56727984f4e3', '5a03e2d0-22ff-44fb-b295-97bc5644c5a8', 'e13d87cf-7510-4b61-aa79-cf6b190505ae', '31be7ad6-1c9a-442d-9fae-48b2f9ef539b'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3741324b-9d20-4a89-b9ba-190da5bd4d55 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3741324b-9d20-4a89-b9ba-190da5bd4d55 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3741324b-9d20-4a89-b9ba-190da5bd4d55 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3741324b-9d20-4a89-b9ba-190da5bd4d55 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3741324b-9d20-4a89-b9ba-190da5bd4d55 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3741324b-9d20-4a89-b9ba-190da5bd4d55 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:04 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:04 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:04 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3741324b-9d20-4a89-b9ba-190da5bd4d55 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.233s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:04 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-3741324b-9d20-4a89-b9ba-190da5bd4d55 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:04 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-3741324b-9d20-4a89-b9ba-190da5bd4d55 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Deleted volume successfully. Sep 04 16:09:04 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3741324b-9d20-4a89-b9ba-190da5bd4d55 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-aaa5d4e2-d9f3-4675-b71d-b050609c05a8-delete_volume" released by "delete_volume" :: held 1.020s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:04 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-91076901-dd88-4f04-b3fe-a1309692fe0d tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "cinder-6d9a251b-792d-47f1-ac70-bda63b98c654-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:04 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-91076901-dd88-4f04-b3fe-a1309692fe0d tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-6d9a251b-792d-47f1-ac70-bda63b98c654-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:04 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-91076901-dd88-4f04-b3fe-a1309692fe0d tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "cinder-quobyte-6d9a251b-792d-47f1-ac70-bda63b98c654" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:04 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-91076901-dd88-4f04-b3fe-a1309692fe0d tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-quobyte-6d9a251b-792d-47f1-ac70-bda63b98c654" acquired by "delete_volume" :: waited 0.014s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:04 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[002b61bd-7251-45c4-baa0-359d49b6b4e5]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-91076901-dd88-4f04-b3fe-a1309692fe0d tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d9a251b-792d-47f1-ac70-bda63b98c654 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:04 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d9a251b-792d-47f1-ac70-bda63b98c654 Sep 04 16:09:04 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:05 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-91076901-dd88-4f04-b3fe-a1309692fe0d tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d9a251b-792d-47f1-ac70-bda63b98c654" returned: 0 in 0.386s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-91076901-dd88-4f04-b3fe-a1309692fe0d tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d9a251b-792d-47f1-ac70-bda63b98c654 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:05 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d9a251b-792d-47f1-ac70-bda63b98c654 Sep 04 16:09:05 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:05 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-91076901-dd88-4f04-b3fe-a1309692fe0d tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d9a251b-792d-47f1-ac70-bda63b98c654" returned: 0 in 0.235s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-91076901-dd88-4f04-b3fe-a1309692fe0d tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-quobyte-6d9a251b-792d-47f1-ac70-bda63b98c654" released by "delete_volume" :: held 0.658s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-91076901-dd88-4f04-b3fe-a1309692fe0d tempest-CreateVolumesFromSnapshotTest-1986151947 None] Created reservations ['2eb8864d-03dd-4959-9f7c-1c1a833f6cc9', 'eff7dfef-aa9c-47cd-8cbb-8144739a21bc', '6956a40c-c528-41c7-bb6d-57b75dfc833e', '048b14e6-ad30-44fb-9134-56bb3f590798'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-91076901-dd88-4f04-b3fe-a1309692fe0d tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-91076901-dd88-4f04-b3fe-a1309692fe0d tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-91076901-dd88-4f04-b3fe-a1309692fe0d tempest-CreateVolumesFromSnapshotTest-1986151947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-91076901-dd88-4f04-b3fe-a1309692fe0d tempest-CreateVolumesFromSnapshotTest-1986151947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-91076901-dd88-4f04-b3fe-a1309692fe0d tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-91076901-dd88-4f04-b3fe-a1309692fe0d tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:05 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:05 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:05 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-91076901-dd88-4f04-b3fe-a1309692fe0d tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.256s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-91076901-dd88-4f04-b3fe-a1309692fe0d tempest-CreateVolumesFromSnapshotTest-1986151947 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:05 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-91076901-dd88-4f04-b3fe-a1309692fe0d tempest-CreateVolumesFromSnapshotTest-1986151947 None] Deleted volume successfully. Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-91076901-dd88-4f04-b3fe-a1309692fe0d tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-6d9a251b-792d-47f1-ac70-bda63b98c654-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "cinder-ebc5b08b-8725-4262-86b4-b89caf39a031-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-ebc5b08b-8725-4262-86b4-b89caf39a031-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "cinder-quobyte-c0ea755a-84b0-4b2d-bde3-2407be04d562" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-quobyte-c0ea755a-84b0-4b2d-bde3-2407be04d562" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "cinder-quobyte-ebc5b08b-8725-4262-86b4-b89caf39a031" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-quobyte-ebc5b08b-8725-4262-86b4-b89caf39a031" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Deleting offline snapshot ebc5b08b-8725-4262-86b4-b89caf39a031 of volume c0ea755a-84b0-4b2d-bde3-2407be04d562 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] snapshot_file for this snap is: volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.ebc5b08b-8725-4262-86b4-b89caf39a031 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a08b9dc-d5b2-4deb-904e-c5d2da2cd74b]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.ebc5b08b-8725-4262-86b4-b89caf39a031 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:06 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.ebc5b08b-8725-4262-86b4-b89caf39a031 Sep 04 16:09:06 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:06 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.ebc5b08b-8725-4262-86b4-b89caf39a031" returned: 0 in 0.365s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:06 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0ea755a-84b0-4b2d-bde3-2407be04d562(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:09:06 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3d2756-f4df-413d-aa09-297e189863dc]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:06 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562 Sep 04 16:09:06 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:06 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562" returned: 0 in 0.367s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.ebc5b08b-8725-4262-86b4-b89caf39a031 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:06 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.ebc5b08b-8725-4262-86b4-b89caf39a031 Sep 04 16:09:06 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:07 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.ebc5b08b-8725-4262-86b4-b89caf39a031" returned: 0 in 0.331s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.ebc5b08b-8725-4262-86b4-b89caf39a031 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:07 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.ebc5b08b-8725-4262-86b4-b89caf39a031 Sep 04 16:09:07 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:07 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562.ebc5b08b-8725-4262-86b4-b89caf39a031" returned: 0 in 0.247s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-quobyte-ebc5b08b-8725-4262-86b4-b89caf39a031" released by "_delete_snapshot" :: held 1.403s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-quobyte-c0ea755a-84b0-4b2d-bde3-2407be04d562" released by "delete_snapshot" :: held 1.426s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:07 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Created reservations ['f8dd5c04-770e-43f8-a4c5-c256b6ff3b35', '5333fea5-037a-4e69-b8c8-8cdb67fbcf33', '98ae2a69-622a-4a2b-920e-6f1cd5887e29', '717ea5b5-8b9c-4279-bfd6-4bec09eeadae'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:07 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Delete snapshot completed successfully. Sep 04 16:09:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-106b7fa9-84b9-44fb-ab6e-ae95b6062801 tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-ebc5b08b-8725-4262-86b4-b89caf39a031-delete_snapshot" released by "delete_snapshot" :: held 1.557s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1b19c3dc-ed52-4e99-81df-3a029630231f tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "cinder-c0ea755a-84b0-4b2d-bde3-2407be04d562-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1b19c3dc-ed52-4e99-81df-3a029630231f tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-c0ea755a-84b0-4b2d-bde3-2407be04d562-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1b19c3dc-ed52-4e99-81df-3a029630231f tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "cinder-quobyte-c0ea755a-84b0-4b2d-bde3-2407be04d562" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1b19c3dc-ed52-4e99-81df-3a029630231f tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-quobyte-c0ea755a-84b0-4b2d-bde3-2407be04d562" acquired by "delete_volume" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:08 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0dd3ca-0716-4c13-af10-344e241e91a3]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1b19c3dc-ed52-4e99-81df-3a029630231f tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:08 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562 Sep 04 16:09:08 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:08 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1b19c3dc-ed52-4e99-81df-3a029630231f tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562" returned: 0 in 0.351s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1b19c3dc-ed52-4e99-81df-3a029630231f tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:08 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562 Sep 04 16:09:08 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:08 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1b19c3dc-ed52-4e99-81df-3a029630231f tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c0ea755a-84b0-4b2d-bde3-2407be04d562" returned: 0 in 0.278s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1b19c3dc-ed52-4e99-81df-3a029630231f tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-quobyte-c0ea755a-84b0-4b2d-bde3-2407be04d562" released by "delete_volume" :: held 0.678s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:08 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-1b19c3dc-ed52-4e99-81df-3a029630231f tempest-CreateVolumesFromSnapshotTest-1986151947 None] Created reservations ['722f6934-c2be-4e49-a32f-8724a7869fbd', 'a29e7c61-5874-4dc0-b3f7-f04151e691b3', 'af2c0413-2794-449e-ad9d-646516d2edb4', 'ce66e3d6-d3bc-47ee-b6e2-9e41f14c961a'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1b19c3dc-ed52-4e99-81df-3a029630231f tempest-CreateVolumesFromSnapshotTest-1986151947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1b19c3dc-ed52-4e99-81df-3a029630231f tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1b19c3dc-ed52-4e99-81df-3a029630231f tempest-CreateVolumesFromSnapshotTest-1986151947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1b19c3dc-ed52-4e99-81df-3a029630231f tempest-CreateVolumesFromSnapshotTest-1986151947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1b19c3dc-ed52-4e99-81df-3a029630231f tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1b19c3dc-ed52-4e99-81df-3a029630231f tempest-CreateVolumesFromSnapshotTest-1986151947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:08 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:08 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:09 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1b19c3dc-ed52-4e99-81df-3a029630231f tempest-CreateVolumesFromSnapshotTest-1986151947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.242s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:09 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-1b19c3dc-ed52-4e99-81df-3a029630231f tempest-CreateVolumesFromSnapshotTest-1986151947 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:09 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-1b19c3dc-ed52-4e99-81df-3a029630231f tempest-CreateVolumesFromSnapshotTest-1986151947 None] Deleted volume successfully. Sep 04 16:09:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1b19c3dc-ed52-4e99-81df-3a029630231f tempest-CreateVolumesFromSnapshotTest-1986151947 None] Lock "cinder-c0ea755a-84b0-4b2d-bde3-2407be04d562-delete_volume" released by "delete_volume" :: held 1.126s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Flow 'volume_create_manager' (34f1ce06-e7c8-43c6-a385-21947c2a7534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90489cb-5a79-47de-b212-103dae7f452e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90489cb-5a79-47de-b212-103dae7f452e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2046862545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca433731-9843-471b-b076-5c5cb5452cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00a50b48f49747dfb699b1f8a09a4fea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:12Z,use_quota=True,user_id='881f670834d1499da4e39d5df1f2f43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a62a6be-bbb8-4750-816b-a67e8bbb1b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a62a6be-bbb8-4750-816b-a67e8bbb1b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb18497-e001-45d3-9c58-b7fdb8e76b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb18497-e001-45d3-9c58-b7fdb8e76b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca433731-9843-471b-b076-5c5cb5452cfc', 'volume_name': 'volume-ca433731-9843-471b-b076-5c5cb5452cfc', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b9c93d-9454-4937-8b6f-cad786160300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b9c93d-9454-4937-8b6f-cad786160300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc1ca69-57b9-46e7-b028-d5a9e8119e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:12 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Volume ca433731-9843-471b-b076-5c5cb5452cfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca433731-9843-471b-b076-5c5cb5452cfc', 'volume_size': 1} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2046862545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca433731-9843-471b-b076-5c5cb5452cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00a50b48f49747dfb699b1f8a09a4fea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:12Z,use_quota=True,user_id='881f670834d1499da4e39d5df1f2f43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Creating volume ca433731-9843-471b-b076-5c5cb5452cfc {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:12 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ca433731-9843-471b-b076-5c5cb5452cfc 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:12 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ca433731-9843-471b-b076-5c5cb5452cfc 1073741824 Sep 04 16:09:12 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:12 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ca433731-9843-471b-b076-5c5cb5452cfc 1073741824" returned: 0 in 0.385s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ca433731-9843-471b-b076-5c5cb5452cfc {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:12 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ca433731-9843-471b-b076-5c5cb5452cfc Sep 04 16:09:12 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:13 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ca433731-9843-471b-b076-5c5cb5452cfc" returned: 0 in 0.232s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] <== create_volume: return (656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.658s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc1ca69-57b9-46e7-b028-d5a9e8119e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca433731-9843-471b-b076-5c5cb5452cfc', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d377df-6ad4-457d-9504-e32dda98ae99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:13 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Volume volume-ca433731-9843-471b-b076-5c5cb5452cfc (ca433731-9843-471b-b076-5c5cb5452cfc): created successfully Sep 04 16:09:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d377df-6ad4-457d-9504-e32dda98ae99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Flow 'volume_create_manager' (34f1ce06-e7c8-43c6-a385-21947c2a7534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:13 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-080db012-3a01-458b-b31f-5aeeae600e50 tempest-ProjectReaderTests-1704616920 None] Created volume successfully. Sep 04 16:09:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d13c10dd-dd44-4491-8072-75046f9b54ae tempest-ProjectReaderTests-1704616920 None] Acquiring lock "cinder-ca433731-9843-471b-b076-5c5cb5452cfc-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d13c10dd-dd44-4491-8072-75046f9b54ae tempest-ProjectReaderTests-1704616920 None] Lock "cinder-ca433731-9843-471b-b076-5c5cb5452cfc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d13c10dd-dd44-4491-8072-75046f9b54ae tempest-ProjectReaderTests-1704616920 None] Acquiring lock "cinder-quobyte-ca433731-9843-471b-b076-5c5cb5452cfc" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d13c10dd-dd44-4491-8072-75046f9b54ae tempest-ProjectReaderTests-1704616920 None] Lock "cinder-quobyte-ca433731-9843-471b-b076-5c5cb5452cfc" acquired by "delete_volume" :: waited 0.013s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:13 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[362f9452-acaf-430d-86d1-061a753e0a52]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d13c10dd-dd44-4491-8072-75046f9b54ae tempest-ProjectReaderTests-1704616920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ca433731-9843-471b-b076-5c5cb5452cfc {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:13 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ca433731-9843-471b-b076-5c5cb5452cfc Sep 04 16:09:13 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:13 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d13c10dd-dd44-4491-8072-75046f9b54ae tempest-ProjectReaderTests-1704616920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ca433731-9843-471b-b076-5c5cb5452cfc" returned: 0 in 0.340s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d13c10dd-dd44-4491-8072-75046f9b54ae tempest-ProjectReaderTests-1704616920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ca433731-9843-471b-b076-5c5cb5452cfc {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:13 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ca433731-9843-471b-b076-5c5cb5452cfc Sep 04 16:09:13 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:14 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d13c10dd-dd44-4491-8072-75046f9b54ae tempest-ProjectReaderTests-1704616920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ca433731-9843-471b-b076-5c5cb5452cfc" returned: 0 in 0.228s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d13c10dd-dd44-4491-8072-75046f9b54ae tempest-ProjectReaderTests-1704616920 None] Lock "cinder-quobyte-ca433731-9843-471b-b076-5c5cb5452cfc" released by "delete_volume" :: held 0.604s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:14 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-d13c10dd-dd44-4491-8072-75046f9b54ae tempest-ProjectReaderTests-1704616920 None] Created reservations ['5c1db109-378c-40fc-827e-67fae91ffe3a', 'f66a4440-7117-4f35-97a9-8310dd2e1836', '86f03046-1662-4da6-9073-0fa143df59e4', 'd23ed831-9ad4-49ba-bd70-3fc2979b2734'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d13c10dd-dd44-4491-8072-75046f9b54ae tempest-ProjectReaderTests-1704616920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d13c10dd-dd44-4491-8072-75046f9b54ae tempest-ProjectReaderTests-1704616920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d13c10dd-dd44-4491-8072-75046f9b54ae tempest-ProjectReaderTests-1704616920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d13c10dd-dd44-4491-8072-75046f9b54ae tempest-ProjectReaderTests-1704616920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d13c10dd-dd44-4491-8072-75046f9b54ae tempest-ProjectReaderTests-1704616920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d13c10dd-dd44-4491-8072-75046f9b54ae tempest-ProjectReaderTests-1704616920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:14 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:14 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:14 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d13c10dd-dd44-4491-8072-75046f9b54ae tempest-ProjectReaderTests-1704616920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.237s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:14 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-d13c10dd-dd44-4491-8072-75046f9b54ae tempest-ProjectReaderTests-1704616920 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:14 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-d13c10dd-dd44-4491-8072-75046f9b54ae tempest-ProjectReaderTests-1704616920 None] Deleted volume successfully. Sep 04 16:09:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d13c10dd-dd44-4491-8072-75046f9b54ae tempest-ProjectReaderTests-1704616920 None] Lock "cinder-ca433731-9843-471b-b076-5c5cb5452cfc-delete_volume" released by "delete_volume" :: held 1.018s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:14 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Flow 'volume_create_manager' (55147a51-b93c-4ae4-9c51-9d4279d90f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0f701ce-191c-411d-be97-2041115d4e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0f701ce-191c-411d-be97-2041115d4e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-897936493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9877bb-db78-4286-bff9-dbfdabd3a85a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00a50b48f49747dfb699b1f8a09a4fea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:15Z,use_quota=True,user_id='881f670834d1499da4e39d5df1f2f43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff93a02f-762a-46b3-a6ed-24b5ddc735db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff93a02f-762a-46b3-a6ed-24b5ddc735db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38a39cb-5568-4480-831f-0138f916f1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38a39cb-5568-4480-831f-0138f916f1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d9877bb-db78-4286-bff9-dbfdabd3a85a', 'volume_name': 'volume-9d9877bb-db78-4286-bff9-dbfdabd3a85a', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74826675-a986-4b40-b3f7-331d3987dd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74826675-a986-4b40-b3f7-331d3987dd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42180b02-a1b4-4a90-bae7-4d9e0ac52d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:15 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Volume 9d9877bb-db78-4286-bff9-dbfdabd3a85a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d9877bb-db78-4286-bff9-dbfdabd3a85a', 'volume_size': 1} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-897936493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9877bb-db78-4286-bff9-dbfdabd3a85a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00a50b48f49747dfb699b1f8a09a4fea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:15Z,use_quota=True,user_id='881f670834d1499da4e39d5df1f2f43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Creating volume 9d9877bb-db78-4286-bff9-dbfdabd3a85a {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:15 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9d9877bb-db78-4286-bff9-dbfdabd3a85a 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:15 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9d9877bb-db78-4286-bff9-dbfdabd3a85a 1073741824 Sep 04 16:09:15 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:15 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9d9877bb-db78-4286-bff9-dbfdabd3a85a 1073741824" returned: 0 in 0.387s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9d9877bb-db78-4286-bff9-dbfdabd3a85a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:15 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9d9877bb-db78-4286-bff9-dbfdabd3a85a Sep 04 16:09:15 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:15 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9d9877bb-db78-4286-bff9-dbfdabd3a85a" returned: 0 in 0.235s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] <== create_volume: return (660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42180b02-a1b4-4a90-bae7-4d9e0ac52d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d9877bb-db78-4286-bff9-dbfdabd3a85a', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a8171d-dbd2-4d6a-8708-c1fdfdf72464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:15 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Volume volume-9d9877bb-db78-4286-bff9-dbfdabd3a85a (9d9877bb-db78-4286-bff9-dbfdabd3a85a): created successfully Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a8171d-dbd2-4d6a-8708-c1fdfdf72464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:15 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Flow 'volume_create_manager' (55147a51-b93c-4ae4-9c51-9d4279d90f7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:15 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-4e91c196-81d7-4e4e-84e5-462076057a52 tempest-ProjectReaderTests-1704616920 None] Created volume successfully. Sep 04 16:09:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-82b29597-de9f-45e6-b945-1eb1b6947eac tempest-ProjectReaderTests-1704616920 None] Acquiring lock "cinder-9d9877bb-db78-4286-bff9-dbfdabd3a85a-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-82b29597-de9f-45e6-b945-1eb1b6947eac tempest-ProjectReaderTests-1704616920 None] Lock "cinder-9d9877bb-db78-4286-bff9-dbfdabd3a85a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-82b29597-de9f-45e6-b945-1eb1b6947eac tempest-ProjectReaderTests-1704616920 None] Acquiring lock "cinder-quobyte-9d9877bb-db78-4286-bff9-dbfdabd3a85a" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-82b29597-de9f-45e6-b945-1eb1b6947eac tempest-ProjectReaderTests-1704616920 None] Lock "cinder-quobyte-9d9877bb-db78-4286-bff9-dbfdabd3a85a" acquired by "delete_volume" :: waited 0.013s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:16 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace5d3fe-690a-43b3-aabd-52c6132dd532]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-82b29597-de9f-45e6-b945-1eb1b6947eac tempest-ProjectReaderTests-1704616920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9d9877bb-db78-4286-bff9-dbfdabd3a85a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:16 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9d9877bb-db78-4286-bff9-dbfdabd3a85a Sep 04 16:09:16 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:16 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-82b29597-de9f-45e6-b945-1eb1b6947eac tempest-ProjectReaderTests-1704616920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9d9877bb-db78-4286-bff9-dbfdabd3a85a" returned: 0 in 0.339s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-82b29597-de9f-45e6-b945-1eb1b6947eac tempest-ProjectReaderTests-1704616920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9d9877bb-db78-4286-bff9-dbfdabd3a85a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:16 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9d9877bb-db78-4286-bff9-dbfdabd3a85a Sep 04 16:09:16 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:16 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-82b29597-de9f-45e6-b945-1eb1b6947eac tempest-ProjectReaderTests-1704616920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9d9877bb-db78-4286-bff9-dbfdabd3a85a" returned: 0 in 0.228s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-82b29597-de9f-45e6-b945-1eb1b6947eac tempest-ProjectReaderTests-1704616920 None] Lock "cinder-quobyte-9d9877bb-db78-4286-bff9-dbfdabd3a85a" released by "delete_volume" :: held 0.600s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:16 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-82b29597-de9f-45e6-b945-1eb1b6947eac tempest-ProjectReaderTests-1704616920 None] Created reservations ['716898cb-e651-489b-a488-2c2fa9dcb0a9', 'ac88d6cc-3d2d-4667-93e2-7d689361252c', 'c79a6e69-a2e6-4bad-9a51-cc72158d3830', '57555cae-465e-4ebc-8d4b-ceca31613759'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-82b29597-de9f-45e6-b945-1eb1b6947eac tempest-ProjectReaderTests-1704616920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-82b29597-de9f-45e6-b945-1eb1b6947eac tempest-ProjectReaderTests-1704616920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-82b29597-de9f-45e6-b945-1eb1b6947eac tempest-ProjectReaderTests-1704616920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-82b29597-de9f-45e6-b945-1eb1b6947eac tempest-ProjectReaderTests-1704616920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-82b29597-de9f-45e6-b945-1eb1b6947eac tempest-ProjectReaderTests-1704616920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-82b29597-de9f-45e6-b945-1eb1b6947eac tempest-ProjectReaderTests-1704616920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:16 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:16 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:17 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-82b29597-de9f-45e6-b945-1eb1b6947eac tempest-ProjectReaderTests-1704616920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.224s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:17 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-82b29597-de9f-45e6-b945-1eb1b6947eac tempest-ProjectReaderTests-1704616920 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:17 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-82b29597-de9f-45e6-b945-1eb1b6947eac tempest-ProjectReaderTests-1704616920 None] Deleted volume successfully. Sep 04 16:09:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-82b29597-de9f-45e6-b945-1eb1b6947eac tempest-ProjectReaderTests-1704616920 None] Lock "cinder-9d9877bb-db78-4286-bff9-dbfdabd3a85a-delete_volume" released by "delete_volume" :: held 1.002s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:26 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=101,cinder:SELECT=67,cinder:INSERT=19,cinder:DELETE=11 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:09:27 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=63,cinder:UPDATE=89,cinder:DELETE=6,cinder:INSERT=26 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Flow 'volume_create_manager' (08338cd7-a64d-4fd6-aeb8-ae512ee9c33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (927eace3-860d-410e-97b6-8dc7e32de593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (927eace3-860d-410e-97b6-8dc7e32de593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-54015883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f4c260-21b3-4494-b338-a16ab1376ee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ca19950b004b5aa0505cf7b42a5ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:33Z,use_quota=True,user_id='ecb56c9816ba428cbeef9b4dfaec3fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb6cd91-da5b-463a-9335-f869ad4ab076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb6cd91-da5b-463a-9335-f869ad4ab076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053afe79-20e4-42f2-8cc1-8e3963a1b669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053afe79-20e4-42f2-8cc1-8e3963a1b669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7f4c260-21b3-4494-b338-a16ab1376ee9', 'volume_name': 'volume-c7f4c260-21b3-4494-b338-a16ab1376ee9', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ff04db-b289-4796-bda9-b24cfdbe7568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ff04db-b289-4796-bda9-b24cfdbe7568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf260cee-41d8-46eb-a0e7-5b83b7e1edc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:33 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Volume c7f4c260-21b3-4494-b338-a16ab1376ee9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7f4c260-21b3-4494-b338-a16ab1376ee9', 'volume_size': 1} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-54015883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f4c260-21b3-4494-b338-a16ab1376ee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ca19950b004b5aa0505cf7b42a5ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:33Z,use_quota=True,user_id='ecb56c9816ba428cbeef9b4dfaec3fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Creating volume c7f4c260-21b3-4494-b338-a16ab1376ee9 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:33 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c7f4c260-21b3-4494-b338-a16ab1376ee9 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:33 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c7f4c260-21b3-4494-b338-a16ab1376ee9 1073741824 Sep 04 16:09:33 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Flow 'volume_create_manager' (725484f9-ab51-4166-bff4-cdecbabac4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d423015d-8ccb-4d29-b7e6-47bce5ead4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d423015d-8ccb-4d29-b7e6-47bce5ead4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1419454954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67eaa988-66e8-44ab-9a53-7b5d9754e7b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107a8912516146949fea16dbaa1b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:34Z,use_quota=True,user_id='81c319b4cd194f8191680e53427cd111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce54e840-7175-41a8-86d9-68c0fc5839fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce54e840-7175-41a8-86d9-68c0fc5839fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98e9f44-8f13-473b-95a7-f6b617973ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98e9f44-8f13-473b-95a7-f6b617973ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67eaa988-66e8-44ab-9a53-7b5d9754e7b2', 'volume_name': 'volume-67eaa988-66e8-44ab-9a53-7b5d9754e7b2', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (691ccc33-20e5-4835-89e4-873db96fd3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (691ccc33-20e5-4835-89e4-873db96fd3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1945a2-4a03-41c7-afb4-8614c2b6b8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Volume 67eaa988-66e8-44ab-9a53-7b5d9754e7b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67eaa988-66e8-44ab-9a53-7b5d9754e7b2', 'volume_size': 1} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Flow 'volume_create_manager' (6566c513-1ed7-4c98-82cf-83a6333ba3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716e9971-1cc5-485a-aa1d-6c9e00c9584c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716e9971-1cc5-485a-aa1d-6c9e00c9584c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1759461775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=002c1dc2-d726-4ed5-b95a-758d7f05184c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ca19950b004b5aa0505cf7b42a5ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:34Z,use_quota=True,user_id='ecb56c9816ba428cbeef9b4dfaec3fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2a3050-0196-4df3-a196-e5ba8fee4c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2a3050-0196-4df3-a196-e5ba8fee4c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a391bda7-05ed-4dfa-832f-2aa584e050b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a391bda7-05ed-4dfa-832f-2aa584e050b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '002c1dc2-d726-4ed5-b95a-758d7f05184c', 'volume_name': 'volume-002c1dc2-d726-4ed5-b95a-758d7f05184c', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f526fc-f122-4205-be98-1cc13474ef95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f526fc-f122-4205-be98-1cc13474ef95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cb714d-afaa-44fa-8e46-9d46bd48cc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Volume 002c1dc2-d726-4ed5-b95a-758d7f05184c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-002c1dc2-d726-4ed5-b95a-758d7f05184c', 'volume_size': 1} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:34 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c7f4c260-21b3-4494-b338-a16ab1376ee9 1073741824" returned: 0 in 0.584s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c7f4c260-21b3-4494-b338-a16ab1376ee9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:34 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c7f4c260-21b3-4494-b338-a16ab1376ee9 Sep 04 16:09:34 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Flow 'volume_create_manager' (ee893a3a-b463-4901-a5ac-8e72cba2c470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be23a3d0-b935-453e-a440-d8979d142896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Flow 'volume_create_manager' (583f48e9-57fe-426e-b8fa-976bfda49de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0337d0-6317-402a-81f5-bd5393b4dc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be23a3d0-b935-453e-a440-d8979d142896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1397225798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d76a8e8-fcc7-4e74-80bc-8c464717aeb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ca19950b004b5aa0505cf7b42a5ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:34Z,use_quota=True,user_id='ecb56c9816ba428cbeef9b4dfaec3fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74cad1d-2596-4e7c-9769-ed8048670c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74cad1d-2596-4e7c-9769-ed8048670c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a772a1b0-6636-4e9d-b147-6bd0612b10b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a772a1b0-6636-4e9d-b147-6bd0612b10b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d76a8e8-fcc7-4e74-80bc-8c464717aeb1', 'volume_name': 'volume-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7b4981-1dab-4551-b7c1-5094ad72af80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7b4981-1dab-4551-b7c1-5094ad72af80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e30915-2ce6-4378-96ac-73782f991c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Volume 6d76a8e8-fcc7-4e74-80bc-8c464717aeb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1', 'volume_size': 1} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c7f4c260-21b3-4494-b338-a16ab1376ee9" returned: 0 in 0.428s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.586s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1419454954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67eaa988-66e8-44ab-9a53-7b5d9754e7b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107a8912516146949fea16dbaa1b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:34Z,use_quota=True,user_id='81c319b4cd194f8191680e53427cd111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Creating volume 67eaa988-66e8-44ab-9a53-7b5d9754e7b2 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:34 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67eaa988-66e8-44ab-9a53-7b5d9754e7b2 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0337d0-6317-402a-81f5-bd5393b4dc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1633234355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5300568e-06f1-4b48-92a3-655220d0ca98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963ca1822b2446a0aff0adfdd256917c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:34Z,use_quota=True,user_id='60a57c8abb4744a484d009670fc1b8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6572bf-5d19-4401-b00b-19b30d8b4f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67eaa988-66e8-44ab-9a53-7b5d9754e7b2 1073741824 Sep 04 16:09:34 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6572bf-5d19-4401-b00b-19b30d8b4f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc96b2a-80dd-4f1b-914a-d09cc6efd484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc96b2a-80dd-4f1b-914a-d09cc6efd484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5300568e-06f1-4b48-92a3-655220d0ca98', 'volume_name': 'volume-5300568e-06f1-4b48-92a3-655220d0ca98', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db425862-b38d-431c-a866-8561e50567ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db425862-b38d-431c-a866-8561e50567ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c63f43-6f41-4995-850e-b0cc3504b6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Volume 5300568e-06f1-4b48-92a3-655220d0ca98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5300568e-06f1-4b48-92a3-655220d0ca98', 'volume_size': 1} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf260cee-41d8-46eb-a0e7-5b83b7e1edc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7f4c260-21b3-4494-b338-a16ab1376ee9', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9c03f6-be5a-4f82-9dfc-cea0c788139f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Volume volume-c7f4c260-21b3-4494-b338-a16ab1376ee9 (c7f4c260-21b3-4494-b338-a16ab1376ee9): created successfully Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9c03f6-be5a-4f82-9dfc-cea0c788139f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Flow 'volume_create_manager' (08338cd7-a64d-4fd6-aeb8-ae512ee9c33a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Flow 'volume_create_manager' (89280a1b-3166-43c4-9655-0325c31388c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bee23f5-f20e-4f8c-927f-9b436f5d776d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:34 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-a751f8df-91b9-492d-8656-c8e8b72de9fb tempest-CreateVolumesFromImageTest-993053492 None] Created volume successfully. Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bee23f5-f20e-4f8c-927f-9b436f5d776d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1846867260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=862c9eae-eea2-462c-8374-62380eb0ea69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ca19950b004b5aa0505cf7b42a5ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:35Z,use_quota=True,user_id='ecb56c9816ba428cbeef9b4dfaec3fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:34 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0dd267a-b7af-4b17-9cf5-951fd88d146a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:34 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0dd267a-b7af-4b17-9cf5-951fd88d146a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eede72d3-44a3-45c2-8d7b-5f088c808dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eede72d3-44a3-45c2-8d7b-5f088c808dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '862c9eae-eea2-462c-8374-62380eb0ea69', 'volume_name': 'volume-862c9eae-eea2-462c-8374-62380eb0ea69', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202d887e-5209-4d69-a1c6-c7948024ed2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202d887e-5209-4d69-a1c6-c7948024ed2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88dcafd8-7d42-4fd1-a699-14fc57f93341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:35 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Volume 862c9eae-eea2-462c-8374-62380eb0ea69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-862c9eae-eea2-462c-8374-62380eb0ea69', 'volume_size': 1} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Flow 'volume_create_manager' (96a31565-24e4-4e2f-a8ee-58004d76d9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c3e6df-5ea8-4635-b65b-80fab0c2163e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:35 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c3e6df-5ea8-4635-b65b-80fab0c2163e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-717456562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c17c4686-7429-4a78-b872-42f5044664be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ca19950b004b5aa0505cf7b42a5ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:35Z,use_quota=True,user_id='ecb56c9816ba428cbeef9b4dfaec3fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5051f32-663d-4652-a187-48ace1f8977a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5051f32-663d-4652-a187-48ace1f8977a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f600a7-1148-43a7-a4b0-70c664224881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f600a7-1148-43a7-a4b0-70c664224881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c17c4686-7429-4a78-b872-42f5044664be', 'volume_name': 'volume-c17c4686-7429-4a78-b872-42f5044664be', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad7866e-d2a1-454d-af92-3343790e5097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad7866e-d2a1-454d-af92-3343790e5097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e73e71-ba41-4254-9dae-951ad83ae909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:35 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Volume c17c4686-7429-4a78-b872-42f5044664be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c17c4686-7429-4a78-b872-42f5044664be', 'volume_size': 1} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67eaa988-66e8-44ab-9a53-7b5d9754e7b2 1073741824" returned: 0 in 0.662s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67eaa988-66e8-44ab-9a53-7b5d9754e7b2 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:35 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.428s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 28 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 16:09:35 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67eaa988-66e8-44ab-9a53-7b5d9754e7b2 Sep 04 16:09:35 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:35 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67eaa988-66e8-44ab-9a53-7b5d9754e7b2" returned: 0 in 0.246s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.454s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1759461775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=002c1dc2-d726-4ed5-b95a-758d7f05184c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ca19950b004b5aa0505cf7b42a5ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:34Z,use_quota=True,user_id='ecb56c9816ba428cbeef9b4dfaec3fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Creating volume 002c1dc2-d726-4ed5-b95a-758d7f05184c {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:35 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-002c1dc2-d726-4ed5-b95a-758d7f05184c 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:35 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-002c1dc2-d726-4ed5-b95a-758d7f05184c 1073741824 Sep 04 16:09:35 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1945a2-4a03-41c7-afb4-8614c2b6b8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67eaa988-66e8-44ab-9a53-7b5d9754e7b2', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b610cd-4f42-4a23-82e4-31b632d08157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:35 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Volume volume-67eaa988-66e8-44ab-9a53-7b5d9754e7b2 (67eaa988-66e8-44ab-9a53-7b5d9754e7b2): created successfully Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b610cd-4f42-4a23-82e4-31b632d08157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Flow 'volume_create_manager' (725484f9-ab51-4166-bff4-cdecbabac4c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:35 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ed86164f-ea99-471a-ae84-41e2322ec92c tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Created volume successfully. Sep 04 16:09:36 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-002c1dc2-d726-4ed5-b95a-758d7f05184c 1073741824" returned: 0 in 0.480s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-002c1dc2-d726-4ed5-b95a-758d7f05184c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:36 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-002c1dc2-d726-4ed5-b95a-758d7f05184c Sep 04 16:09:36 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:36 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-002c1dc2-d726-4ed5-b95a-758d7f05184c" returned: 0 in 0.270s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:36 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.777s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:36 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1397225798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d76a8e8-fcc7-4e74-80bc-8c464717aeb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ca19950b004b5aa0505cf7b42a5ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:34Z,use_quota=True,user_id='ecb56c9816ba428cbeef9b4dfaec3fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:36 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Creating volume 6d76a8e8-fcc7-4e74-80bc-8c464717aeb1 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:36 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:36 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:36 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:36 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:09:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:36 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cb714d-afaa-44fa-8e46-9d46bd48cc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-002c1dc2-d726-4ed5-b95a-758d7f05184c', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:36 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1 1073741824 Sep 04 16:09:36 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:36 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dfa095a-f00a-4941-b9d6-b5260dc4d524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:36 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Volume volume-002c1dc2-d726-4ed5-b95a-758d7f05184c (002c1dc2-d726-4ed5-b95a-758d7f05184c): created successfully Sep 04 16:09:36 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dfa095a-f00a-4941-b9d6-b5260dc4d524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:36 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Flow 'volume_create_manager' (6566c513-1ed7-4c98-82cf-83a6333ba3e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:36 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-28cd1707-49ab-4a05-95e9-0f738ead3ee3 tempest-CreateVolumesFromImageTest-993053492 None] Created volume successfully. Sep 04 16:09:36 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1 1073741824" returned: 0 in 0.490s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:37 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1 Sep 04 16:09:37 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Flow 'volume_create_manager' (b0d8ab92-c3a5-4510-a067-9fc5fc4e5d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb078eb-30d9-493e-bfa9-d0419169ac9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb078eb-30d9-493e-bfa9-d0419169ac9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2045458230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed811e75-f080-4ebb-814f-739d7aa50fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107a8912516146949fea16dbaa1b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:37Z,use_quota=True,user_id='81c319b4cd194f8191680e53427cd111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c11e4ff9-9c94-48b1-be6d-351139bd16f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c11e4ff9-9c94-48b1-be6d-351139bd16f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ab8aaf-b7f4-411a-b130-4cb441d03487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:37 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ab8aaf-b7f4-411a-b130-4cb441d03487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed811e75-f080-4ebb-814f-739d7aa50fa8', 'volume_name': 'volume-ed811e75-f080-4ebb-814f-739d7aa50fa8', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44759daf-8606-4b37-b6cd-68834cdca4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44759daf-8606-4b37-b6cd-68834cdca4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144534a9-5e93-43df-b2ac-335817018f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:37 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Volume ed811e75-f080-4ebb-814f-739d7aa50fa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed811e75-f080-4ebb-814f-739d7aa50fa8', 'volume_size': 1} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1" returned: 0 in 0.326s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.508s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1633234355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5300568e-06f1-4b48-92a3-655220d0ca98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963ca1822b2446a0aff0adfdd256917c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:34Z,use_quota=True,user_id='60a57c8abb4744a484d009670fc1b8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Creating volume 5300568e-06f1-4b48-92a3-655220d0ca98 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:37 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e30915-2ce6-4378-96ac-73782f991c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52cc5f57-689a-4e06-8511-7b931f330198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:37 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98 1073741824 Sep 04 16:09:37 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:37 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Volume volume-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1 (6d76a8e8-fcc7-4e74-80bc-8c464717aeb1): created successfully Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52cc5f57-689a-4e06-8511-7b931f330198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Flow 'volume_create_manager' (ee893a3a-b463-4901-a5ac-8e72cba2c470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:37 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-a7ecec70-4e9f-4750-be8a-f7225f997f47 tempest-CreateVolumesFromImageTest-993053492 None] Created volume successfully. Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Flow 'volume_create_manager' (c008fa53-c99b-45d4-b9ca-0e1cb67fda45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e77129b8-0e6e-4d5f-a83f-688e5407e749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e77129b8-0e6e-4d5f-a83f-688e5407e749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4fb216-e2c6-4f23-a088-037646086da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96931f6a82d54cf488dda0698580d86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:37Z,use_quota=True,user_id='7813f5bcf10c4a71b22ab1fd72e5c4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(805abb5b-fef1-4809-939c-738dc2720a5b),volume_type_id=805abb5b-fef1-4809-939c-738dc2720a5b)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd34780-1b22-4370-8e9a-cb0506ae2f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd34780-1b22-4370-8e9a-cb0506ae2f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889d1b5b-ac78-4d95-8006-f476d092e1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.image.glance [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Creating Keystone auth plugin from conf {{(pid=87513) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Flow 'volume_create_manager' (fcd59959-ce77-48cb-94f5-fd7bd08ff1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26005a0f-cdf5-4e2c-9992-a5267d4401cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26005a0f-cdf5-4e2c-9992-a5267d4401cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1151510549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b4412c-f6e1-4aca-af44-01b673f3b269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107a8912516146949fea16dbaa1b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:38Z,use_quota=True,user_id='81c319b4cd194f8191680e53427cd111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0222d18a-5659-4d19-803c-0165fe12e395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0222d18a-5659-4d19-803c-0165fe12e395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856e65cc-a9b7-4682-9bb2-12707ece0078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856e65cc-a9b7-4682-9bb2-12707ece0078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83b4412c-f6e1-4aca-af44-01b673f3b269', 'volume_name': 'volume-83b4412c-f6e1-4aca-af44-01b673f3b269', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce17303-5489-4c7b-9f83-de3e945fb8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce17303-5489-4c7b-9f83-de3e945fb8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4655dcbf-c830-4fd3-b3f2-c690bb9f5f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:37 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Volume 83b4412c-f6e1-4aca-af44-01b673f3b269: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83b4412c-f6e1-4aca-af44-01b673f3b269', 'volume_size': 1} Sep 04 16:09:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:38 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98 1073741824" returned: 0 in 0.702s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Flow 'volume_create_manager' (2ce9a283-064e-45ae-9191-4e2de96e9c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14096277-9e75-4f0e-b01b-1b392b3393e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889d1b5b-ac78-4d95-8006-f476d092e1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9c4fb216-e2c6-4f23-a088-037646086da5', 'volume_name': 'volume-9c4fb216-e2c6-4f23-a088-037646086da5', 'volume_size': 1, 'image_id': 'e979f90a-fc87-45de-857c-823b91aa142e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e979f90a-fc87-45de-857c-823b91aa142e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da4736e7182f5dedee1f6a696b49de4e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '96931f6a82d54cf488dda0698580d86b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed5739341399f70f283d03694aa936561d72285e9a5e5845729bc9ddabb64b179129cdabbe7a90e640f7ba5fe322c7f8b3dc1e24727366d6c20b8bf48bb76ddf', 'id': 'e979f90a-fc87-45de-857c-823b91aa142e', 'created_at': datetime.datetime(2026, 9, 4, 14, 9, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 9, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e979f90a-fc87-45de-857c-823b91aa142e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b34512-636c-405b-a129-98d983d1d01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b34512-636c-405b-a129-98d983d1d01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:38 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98 Sep 04 16:09:38 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc62578-b423-4959-be70-8b4c6c44324f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:38 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Volume 9c4fb216-e2c6-4f23-a088-037646086da5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9c4fb216-e2c6-4f23-a088-037646086da5', 'volume_size': 1, 'image_id': 'e979f90a-fc87-45de-857c-823b91aa142e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e979f90a-fc87-45de-857c-823b91aa142e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da4736e7182f5dedee1f6a696b49de4e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '96931f6a82d54cf488dda0698580d86b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed5739341399f70f283d03694aa936561d72285e9a5e5845729bc9ddabb64b179129cdabbe7a90e640f7ba5fe322c7f8b3dc1e24727366d6c20b8bf48bb76ddf', 'id': 'e979f90a-fc87-45de-857c-823b91aa142e', 'created_at': datetime.datetime(2026, 9, 4, 14, 9, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 9, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e979f90a-fc87-45de-857c-823b91aa142e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Trying to clone 9c4fb216-e2c6-4f23-a088-037646086da5 from image e979f90a-fc87-45de-857c-823b91aa142e at location (None, [{'url': 'file:///opt/stack/data/glance/images/e979f90a-fc87-45de-857c-823b91aa142e', 'metadata': {}}]). {{(pid=87513) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14096277-9e75-4f0e-b01b-1b392b3393e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1031650422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=975868c1-f8a4-4855-850c-8b14d67890c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107a8912516146949fea16dbaa1b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:38Z,use_quota=True,user_id='81c319b4cd194f8191680e53427cd111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c18ca6b-bc84-4ce1-a95a-ddab8e92c6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c18ca6b-bc84-4ce1-a95a-ddab8e92c6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe7f278-7629-485a-bb68-378d78e8efe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe7f278-7629-485a-bb68-378d78e8efe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '975868c1-f8a4-4855-850c-8b14d67890c1', 'volume_name': 'volume-975868c1-f8a4-4855-850c-8b14d67890c1', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e51f30-61f1-4564-a7f8-8338ca86045f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e51f30-61f1-4564-a7f8-8338ca86045f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49c32d9-c74d-4a11-84c0-14740d056ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:38 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Volume 975868c1-f8a4-4855-850c-8b14d67890c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-975868c1-f8a4-4855-850c-8b14d67890c1', 'volume_size': 1} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 16:09:38 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Image download 0.00 MB at 0.00 MB/s Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97eaa0a-9fbe-4ee4-a80d-cb7c966b4563]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Flow 'volume_create_manager' (fa4a258d-c974-4efb-98d3-f4c538289214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:38 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339d84c2-27f1-415d-a7e3-25f265f3cf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98" returned: 0 in 0.403s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.498s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1846867260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=862c9eae-eea2-462c-8374-62380eb0ea69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ca19950b004b5aa0505cf7b42a5ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:35Z,use_quota=True,user_id='ecb56c9816ba428cbeef9b4dfaec3fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Creating volume 862c9eae-eea2-462c-8374-62380eb0ea69 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:38 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-862c9eae-eea2-462c-8374-62380eb0ea69 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:38 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD Sep 04 16:09:38 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:38 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-862c9eae-eea2-462c-8374-62380eb0ea69 1073741824 Sep 04 16:09:38 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339d84c2-27f1-415d-a7e3-25f265f3cf5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-674040570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce45cbd-3c19-484e-b6b1-7382c631cfd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107a8912516146949fea16dbaa1b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:38Z,use_quota=True,user_id='81c319b4cd194f8191680e53427cd111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b1252d-3321-46cf-a8ab-b0d39627fc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b1252d-3321-46cf-a8ab-b0d39627fc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b98d593-8bee-457b-9d42-a15905f47ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b98d593-8bee-457b-9d42-a15905f47ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ce45cbd-3c19-484e-b6b1-7382c631cfd8', 'volume_name': 'volume-3ce45cbd-3c19-484e-b6b1-7382c631cfd8', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (437207b4-aaa2-4671-8736-e55630d71edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (437207b4-aaa2-4671-8736-e55630d71edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c028a4ee-7edb-4e54-814e-675a8b72cf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:38 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Volume 3ce45cbd-3c19-484e-b6b1-7382c631cfd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ce45cbd-3c19-484e-b6b1-7382c631cfd8', 'volume_size': 1} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c63f43-6f41-4995-850e-b0cc3504b6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5300568e-06f1-4b48-92a3-655220d0ca98', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9b01a5-6083-4cfb-98e7-98e085c31519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:38 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Volume volume-5300568e-06f1-4b48-92a3-655220d0ca98 (5300568e-06f1-4b48-92a3-655220d0ca98): created successfully Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9b01a5-6083-4cfb-98e7-98e085c31519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Flow 'volume_create_manager' (583f48e9-57fe-426e-b8fa-976bfda49de4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:38 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-221bca03-2299-45c2-8e5d-36d891281faf tempest-CreateVolumesFromSnapshotTest-387280520 None] Created volume successfully. Sep 04 16:09:38 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Flow 'volume_create_manager' (06672008-349f-403e-8ba7-0a37bb79248f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0d3c93-60e9-48f9-a004-17e24a6130ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0d3c93-60e9-48f9-a004-17e24a6130ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1288519910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de1db7e-749b-4d24-80e0-b5e7849f7334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107a8912516146949fea16dbaa1b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:39Z,use_quota=True,user_id='81c319b4cd194f8191680e53427cd111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d4e818-17fc-40a5-97bf-531a1c788e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d4e818-17fc-40a5-97bf-531a1c788e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624001de-0348-4673-8382-074835858925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624001de-0348-4673-8382-074835858925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6de1db7e-749b-4d24-80e0-b5e7849f7334', 'volume_name': 'volume-6de1db7e-749b-4d24-80e0-b5e7849f7334', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccb7ef0-8321-4671-ba14-45e498f27529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccb7ef0-8321-4671-ba14-45e498f27529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:38 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD Sep 04 16:09:38 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a5c66b-fc69-43ef-aff0-3db13c7b8524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:38 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Volume 6de1db7e-749b-4d24-80e0-b5e7849f7334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6de1db7e-749b-4d24-80e0-b5e7849f7334', 'volume_size': 1} Sep 04 16:09:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:39 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-862c9eae-eea2-462c-8374-62380eb0ea69 1073741824" returned: 0 in 0.479s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-862c9eae-eea2-462c-8374-62380eb0ea69 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:39 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-862c9eae-eea2-462c-8374-62380eb0ea69 Sep 04 16:09:39 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:39 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD" returned: 1 in 0.329s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Temporary image e979f90a-fc87-45de-857c-823b91aa142e is fetched for user 7813f5bcf10c4a71b22ab1fd72e5c4a8. {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[11619661-b183-47b7-aacc-e405b875e173]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:39 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-862c9eae-eea2-462c-8374-62380eb0ea69" returned: 0 in 0.235s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.957s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-717456562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c17c4686-7429-4a78-b872-42f5044664be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ca19950b004b5aa0505cf7b42a5ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:35Z,use_quota=True,user_id='ecb56c9816ba428cbeef9b4dfaec3fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Creating volume c17c4686-7429-4a78-b872-42f5044664be {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:39 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c17c4686-7429-4a78-b872-42f5044664be 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88dcafd8-7d42-4fd1-a699-14fc57f93341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-862c9eae-eea2-462c-8374-62380eb0ea69', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:39 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c17c4686-7429-4a78-b872-42f5044664be 1073741824 Sep 04 16:09:39 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed146c6-ba3f-4668-a64d-e3bf4946c25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:39 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Volume volume-862c9eae-eea2-462c-8374-62380eb0ea69 (862c9eae-eea2-462c-8374-62380eb0ea69): created successfully Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed146c6-ba3f-4668-a64d-e3bf4946c25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Flow 'volume_create_manager' (89280a1b-3166-43c4-9655-0325c31388c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:39 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD Sep 04 16:09:39 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:39 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-81753c42-5335-421d-82ad-016f4cd40e59 tempest-CreateVolumesFromImageTest-993053492 None] Created volume successfully. Sep 04 16:09:39 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:39 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD Sep 04 16:09:39 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b3d202a2-e12c-41e4-9d01-31d725a8bc32 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:39 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c17c4686-7429-4a78-b872-42f5044664be 1073741824" returned: 0 in 0.503s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c17c4686-7429-4a78-b872-42f5044664be {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:39 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c17c4686-7429-4a78-b872-42f5044664be Sep 04 16:09:39 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:39 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:09:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:40 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c17c4686-7429-4a78-b872-42f5044664be" returned: 0 in 0.251s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.803s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2045458230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed811e75-f080-4ebb-814f-739d7aa50fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107a8912516146949fea16dbaa1b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:37Z,use_quota=True,user_id='81c319b4cd194f8191680e53427cd111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Creating volume ed811e75-f080-4ebb-814f-739d7aa50fa8 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:40 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ed811e75-f080-4ebb-814f-739d7aa50fa8 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e73e71-ba41-4254-9dae-951ad83ae909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c17c4686-7429-4a78-b872-42f5044664be', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:40 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ed811e75-f080-4ebb-814f-739d7aa50fa8 1073741824 Sep 04 16:09:40 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6154ae0-0ce6-4a21-ae13-5c7b96c2c537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:40 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Volume volume-c17c4686-7429-4a78-b872-42f5044664be (c17c4686-7429-4a78-b872-42f5044664be): created successfully Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6154ae0-0ce6-4a21-ae13-5c7b96c2c537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Flow 'volume_create_manager' (96a31565-24e4-4e2f-a8ee-58004d76d9c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:40 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-fee0bd13-5302-40ce-a5ef-edefbf48f873 tempest-CreateVolumesFromImageTest-993053492 None] Created volume successfully. Sep 04 16:09:40 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ed811e75-f080-4ebb-814f-739d7aa50fa8 1073741824" returned: 0 in 0.400s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ed811e75-f080-4ebb-814f-739d7aa50fa8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:40 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ed811e75-f080-4ebb-814f-739d7aa50fa8 Sep 04 16:09:40 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:40 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ed811e75-f080-4ebb-814f-739d7aa50fa8" returned: 0 in 0.234s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.914s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1151510549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b4412c-f6e1-4aca-af44-01b673f3b269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107a8912516146949fea16dbaa1b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:38Z,use_quota=True,user_id='81c319b4cd194f8191680e53427cd111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Creating volume 83b4412c-f6e1-4aca-af44-01b673f3b269 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:40 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-83b4412c-f6e1-4aca-af44-01b673f3b269 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144534a9-5e93-43df-b2ac-335817018f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed811e75-f080-4ebb-814f-739d7aa50fa8', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:40 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-83b4412c-f6e1-4aca-af44-01b673f3b269 1073741824 Sep 04 16:09:40 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc57b80-5c7b-4ea7-b19e-5d5f6a6fb286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:40 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Volume volume-ed811e75-f080-4ebb-814f-739d7aa50fa8 (ed811e75-f080-4ebb-814f-739d7aa50fa8): created successfully Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc57b80-5c7b-4ea7-b19e-5d5f6a6fb286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Flow 'volume_create_manager' (b0d8ab92-c3a5-4510-a067-9fc5fc4e5d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:40 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-995a5354-03ee-40ec-8d7c-2ad71cbe8e8b tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Created volume successfully. Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-71dce411-1dfc-45ab-9a30-c098a846ede9 tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "cinder-c17c4686-7429-4a78-b872-42f5044664be-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-71dce411-1dfc-45ab-9a30-c098a846ede9 tempest-CreateVolumesFromImageTest-993053492 None] Lock "cinder-c17c4686-7429-4a78-b872-42f5044664be-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-71dce411-1dfc-45ab-9a30-c098a846ede9 tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "cinder-quobyte-c17c4686-7429-4a78-b872-42f5044664be" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-71dce411-1dfc-45ab-9a30-c098a846ede9 tempest-CreateVolumesFromImageTest-993053492 None] Lock "cinder-quobyte-c17c4686-7429-4a78-b872-42f5044664be" acquired by "delete_volume" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8265328-fe65-442f-b82b-7871d2d831c7]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-71dce411-1dfc-45ab-9a30-c098a846ede9 tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c17c4686-7429-4a78-b872-42f5044664be {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:41 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-83b4412c-f6e1-4aca-af44-01b673f3b269 1073741824" returned: 0 in 0.444s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-83b4412c-f6e1-4aca-af44-01b673f3b269 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:41 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-83b4412c-f6e1-4aca-af44-01b673f3b269 Sep 04 16:09:41 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:41 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c17c4686-7429-4a78-b872-42f5044664be Sep 04 16:09:41 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:41 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-83b4412c-f6e1-4aca-af44-01b673f3b269" returned: 0 in 0.268s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.319s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1031650422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=975868c1-f8a4-4855-850c-8b14d67890c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107a8912516146949fea16dbaa1b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:38Z,use_quota=True,user_id='81c319b4cd194f8191680e53427cd111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Creating volume 975868c1-f8a4-4855-850c-8b14d67890c1 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:41 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-975868c1-f8a4-4855-850c-8b14d67890c1 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:41 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-975868c1-f8a4-4855-850c-8b14d67890c1 1073741824 Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4655dcbf-c830-4fd3-b3f2-c690bb9f5f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83b4412c-f6e1-4aca-af44-01b673f3b269', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:41 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:41 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b88b42-095d-4afd-b3fe-d554fc15ffd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-71dce411-1dfc-45ab-9a30-c098a846ede9 tempest-CreateVolumesFromImageTest-993053492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c17c4686-7429-4a78-b872-42f5044664be" returned: 0 in 0.396s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-71dce411-1dfc-45ab-9a30-c098a846ede9 tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c17c4686-7429-4a78-b872-42f5044664be {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:41 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Volume volume-83b4412c-f6e1-4aca-af44-01b673f3b269 (83b4412c-f6e1-4aca-af44-01b673f3b269): created successfully Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b88b42-095d-4afd-b3fe-d554fc15ffd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:41 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c17c4686-7429-4a78-b872-42f5044664be Sep 04 16:09:41 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Flow 'volume_create_manager' (fcd59959-ce77-48cb-94f5-fd7bd08ff1af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:41 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-7bc1f07b-892b-447c-98aa-6be86e052c41 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Created volume successfully. Sep 04 16:09:41 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-71dce411-1dfc-45ab-9a30-c098a846ede9 tempest-CreateVolumesFromImageTest-993053492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c17c4686-7429-4a78-b872-42f5044664be" returned: 0 in 0.282s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-71dce411-1dfc-45ab-9a30-c098a846ede9 tempest-CreateVolumesFromImageTest-993053492 None] Lock "cinder-quobyte-c17c4686-7429-4a78-b872-42f5044664be" released by "delete_volume" :: held 0.716s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:41 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-71dce411-1dfc-45ab-9a30-c098a846ede9 tempest-CreateVolumesFromImageTest-993053492 None] Created reservations ['4b7bd838-fbb7-4216-85e8-97c2b5d8e5f7', '900dc1ce-4124-443f-af31-6ee802712f0d', '345146f1-5006-484a-82fd-c128d5b1c779', '5db1bfff-1c5a-416d-a248-d00c596d2498'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-71dce411-1dfc-45ab-9a30-c098a846ede9 tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-71dce411-1dfc-45ab-9a30-c098a846ede9 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-71dce411-1dfc-45ab-9a30-c098a846ede9 tempest-CreateVolumesFromImageTest-993053492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-71dce411-1dfc-45ab-9a30-c098a846ede9 tempest-CreateVolumesFromImageTest-993053492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-71dce411-1dfc-45ab-9a30-c098a846ede9 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-71dce411-1dfc-45ab-9a30-c098a846ede9 tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:42 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:42 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:42 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-975868c1-f8a4-4855-850c-8b14d67890c1 1073741824" returned: 0 in 0.513s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-975868c1-f8a4-4855-850c-8b14d67890c1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:42 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-975868c1-f8a4-4855-850c-8b14d67890c1 Sep 04 16:09:42 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-eb01c97d-4ca5-4885-aa76-a185a3e8f447 tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "cinder-862c9eae-eea2-462c-8374-62380eb0ea69-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:42 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-71dce411-1dfc-45ab-9a30-c098a846ede9 tempest-CreateVolumesFromImageTest-993053492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.267s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-71dce411-1dfc-45ab-9a30-c098a846ede9 tempest-CreateVolumesFromImageTest-993053492 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:42 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-71dce411-1dfc-45ab-9a30-c098a846ede9 tempest-CreateVolumesFromImageTest-993053492 None] Deleted volume successfully. Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-eb01c97d-4ca5-4885-aa76-a185a3e8f447 tempest-CreateVolumesFromImageTest-993053492 None] Lock "cinder-862c9eae-eea2-462c-8374-62380eb0ea69-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-71dce411-1dfc-45ab-9a30-c098a846ede9 tempest-CreateVolumesFromImageTest-993053492 None] Lock "cinder-c17c4686-7429-4a78-b872-42f5044664be-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-eb01c97d-4ca5-4885-aa76-a185a3e8f447 tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "cinder-quobyte-862c9eae-eea2-462c-8374-62380eb0ea69" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-eb01c97d-4ca5-4885-aa76-a185a3e8f447 tempest-CreateVolumesFromImageTest-993053492 None] Lock "cinder-quobyte-862c9eae-eea2-462c-8374-62380eb0ea69" acquired by "delete_volume" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:42 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-975868c1-f8a4-4855-850c-8b14d67890c1" returned: 0 in 0.299s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.781s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-674040570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce45cbd-3c19-484e-b6b1-7382c631cfd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107a8912516146949fea16dbaa1b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:38Z,use_quota=True,user_id='81c319b4cd194f8191680e53427cd111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Creating volume 3ce45cbd-3c19-484e-b6b1-7382c631cfd8 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:42 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3ce45cbd-3c19-484e-b6b1-7382c631cfd8 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc3dcab-34dd-4b15-9871-99b7b01d7193]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-eb01c97d-4ca5-4885-aa76-a185a3e8f447 tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-862c9eae-eea2-462c-8374-62380eb0ea69 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:42 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3ce45cbd-3c19-484e-b6b1-7382c631cfd8 1073741824 Sep 04 16:09:42 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49c32d9-c74d-4a11-84c0-14740d056ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-975868c1-f8a4-4855-850c-8b14d67890c1', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa71500b-25b1-40af-8304-d2d249b87b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:42 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Volume volume-975868c1-f8a4-4855-850c-8b14d67890c1 (975868c1-f8a4-4855-850c-8b14d67890c1): created successfully Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa71500b-25b1-40af-8304-d2d249b87b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Flow 'volume_create_manager' (2ce9a283-064e-45ae-9191-4e2de96e9c77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:42 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-96bbe40c-8689-4585-ba57-32ca7a75bb12 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Created volume successfully. Sep 04 16:09:42 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-862c9eae-eea2-462c-8374-62380eb0ea69 Sep 04 16:09:42 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:42 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-eb01c97d-4ca5-4885-aa76-a185a3e8f447 tempest-CreateVolumesFromImageTest-993053492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-862c9eae-eea2-462c-8374-62380eb0ea69" returned: 0 in 0.378s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-eb01c97d-4ca5-4885-aa76-a185a3e8f447 tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-862c9eae-eea2-462c-8374-62380eb0ea69 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:42 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-862c9eae-eea2-462c-8374-62380eb0ea69 Sep 04 16:09:42 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:42 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3ce45cbd-3c19-484e-b6b1-7382c631cfd8 1073741824" returned: 0 in 0.467s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3ce45cbd-3c19-484e-b6b1-7382c631cfd8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:42 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3ce45cbd-3c19-484e-b6b1-7382c631cfd8 Sep 04 16:09:42 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:43 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-eb01c97d-4ca5-4885-aa76-a185a3e8f447 tempest-CreateVolumesFromImageTest-993053492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-862c9eae-eea2-462c-8374-62380eb0ea69" returned: 0 in 0.246s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-eb01c97d-4ca5-4885-aa76-a185a3e8f447 tempest-CreateVolumesFromImageTest-993053492 None] Lock "cinder-quobyte-862c9eae-eea2-462c-8374-62380eb0ea69" released by "delete_volume" :: held 0.683s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-eb01c97d-4ca5-4885-aa76-a185a3e8f447 tempest-CreateVolumesFromImageTest-993053492 None] Created reservations ['51963dd3-6309-43ab-b137-9031a9502a20', 'd1c125d7-8a29-4321-85bd-c6acdea6af69', 'a8df0292-b688-4ab0-819e-a13547d18d69', '38c5ef5b-b422-45f6-8915-42ab3faa24b0'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:43 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3ce45cbd-3c19-484e-b6b1-7382c631cfd8" returned: 0 in 0.265s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.188s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1288519910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de1db7e-749b-4d24-80e0-b5e7849f7334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107a8912516146949fea16dbaa1b9235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:39Z,use_quota=True,user_id='81c319b4cd194f8191680e53427cd111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Creating volume 6de1db7e-749b-4d24-80e0-b5e7849f7334 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:43 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6de1db7e-749b-4d24-80e0-b5e7849f7334 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:43 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6de1db7e-749b-4d24-80e0-b5e7849f7334 1073741824 Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c028a4ee-7edb-4e54-814e-675a8b72cf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ce45cbd-3c19-484e-b6b1-7382c631cfd8', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:43 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6babf40b-9d6f-4df7-b3ae-16fb85c46db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:43 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Volume volume-3ce45cbd-3c19-484e-b6b1-7382c631cfd8 (3ce45cbd-3c19-484e-b6b1-7382c631cfd8): created successfully Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6babf40b-9d6f-4df7-b3ae-16fb85c46db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Flow 'volume_create_manager' (fa4a258d-c974-4efb-98d3-f4c538289214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-eb01c97d-4ca5-4885-aa76-a185a3e8f447 tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-eb01c97d-4ca5-4885-aa76-a185a3e8f447 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-eb01c97d-4ca5-4885-aa76-a185a3e8f447 tempest-CreateVolumesFromImageTest-993053492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-eb01c97d-4ca5-4885-aa76-a185a3e8f447 tempest-CreateVolumesFromImageTest-993053492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-eb01c97d-4ca5-4885-aa76-a185a3e8f447 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-eb01c97d-4ca5-4885-aa76-a185a3e8f447 tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:43 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-5653252b-eb67-407a-8169-e31de7fdfdbf tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Created volume successfully. Sep 04 16:09:43 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:43 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4a72ed28-7d88-4990-a3d7-a946303e4e27 tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "cinder-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4a72ed28-7d88-4990-a3d7-a946303e4e27 tempest-CreateVolumesFromImageTest-993053492 None] Lock "cinder-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:43 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-eb01c97d-4ca5-4885-aa76-a185a3e8f447 tempest-CreateVolumesFromImageTest-993053492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.269s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-eb01c97d-4ca5-4885-aa76-a185a3e8f447 tempest-CreateVolumesFromImageTest-993053492 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:43 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-eb01c97d-4ca5-4885-aa76-a185a3e8f447 tempest-CreateVolumesFromImageTest-993053492 None] Deleted volume successfully. Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4a72ed28-7d88-4990-a3d7-a946303e4e27 tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "cinder-quobyte-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-eb01c97d-4ca5-4885-aa76-a185a3e8f447 tempest-CreateVolumesFromImageTest-993053492 None] Lock "cinder-862c9eae-eea2-462c-8374-62380eb0ea69-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4a72ed28-7d88-4990-a3d7-a946303e4e27 tempest-CreateVolumesFromImageTest-993053492 None] Lock "cinder-quobyte-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1" acquired by "delete_volume" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6534f4d5-fd5e-4fe0-88e7-0962c0a65561]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4a72ed28-7d88-4990-a3d7-a946303e4e27 tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:43 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6de1db7e-749b-4d24-80e0-b5e7849f7334 1073741824" returned: 0 in 0.478s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6de1db7e-749b-4d24-80e0-b5e7849f7334 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:43 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1 Sep 04 16:09:43 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:43 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6de1db7e-749b-4d24-80e0-b5e7849f7334 Sep 04 16:09:43 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:43 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4a72ed28-7d88-4990-a3d7-a946303e4e27 tempest-CreateVolumesFromImageTest-993053492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1" returned: 0 in 0.375s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4a72ed28-7d88-4990-a3d7-a946303e4e27 tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:43 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6de1db7e-749b-4d24-80e0-b5e7849f7334" returned: 0 in 0.281s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b3d202a2-e12c-41e4-9d01-31d725a8bc32 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.264s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:43 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1 Sep 04 16:09:43 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a5c66b-fc69-43ef-aff0-3db13c7b8524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6de1db7e-749b-4d24-80e0-b5e7849f7334', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c29de4ac-fd58-491d-9128-b37d37271b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-b3d202a2-e12c-41e4-9d01-31d725a8bc32 tempest-CreateVolumesFromSnapshotTest-387280520 None] Creating offline snapshot c779e7fc-431f-4f50-8ba1-9dab3c1a8994 of volume 5300568e-06f1-4b48-92a3-655220d0ca98 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:09:44 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Volume volume-6de1db7e-749b-4d24-80e0-b5e7849f7334 (6de1db7e-749b-4d24-80e0-b5e7849f7334): created successfully Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c29de4ac-fd58-491d-9128-b37d37271b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Flow 'volume_create_manager' (06672008-349f-403e-8ba7-0a37bb79248f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[764e6cee-c099-431a-8ec2-d43640db6ef3]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b3d202a2-e12c-41e4-9d01-31d725a8bc32 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:44 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-3951b465-814b-4457-8dfb-09ec947a3122 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Created volume successfully. Sep 04 16:09:44 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98 Sep 04 16:09:44 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:44 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4a72ed28-7d88-4990-a3d7-a946303e4e27 tempest-CreateVolumesFromImageTest-993053492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1" returned: 0 in 0.248s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4a72ed28-7d88-4990-a3d7-a946303e4e27 tempest-CreateVolumesFromImageTest-993053492 None] Lock "cinder-quobyte-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1" released by "delete_volume" :: held 0.668s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-4a72ed28-7d88-4990-a3d7-a946303e4e27 tempest-CreateVolumesFromImageTest-993053492 None] Created reservations ['6d2cb600-8abc-4280-8757-0919ac160dcf', 'fb1b4e3c-7b1d-41ba-940a-db17ab309f4c', '63fe2c03-81a2-470a-a992-43e9be86c9a1', 'f4f71535-c370-48a5-8032-1c6d16a5a281'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4a72ed28-7d88-4990-a3d7-a946303e4e27 tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4a72ed28-7d88-4990-a3d7-a946303e4e27 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4a72ed28-7d88-4990-a3d7-a946303e4e27 tempest-CreateVolumesFromImageTest-993053492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4a72ed28-7d88-4990-a3d7-a946303e4e27 tempest-CreateVolumesFromImageTest-993053492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4a72ed28-7d88-4990-a3d7-a946303e4e27 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4a72ed28-7d88-4990-a3d7-a946303e4e27 tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:44 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:44 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:44 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c45d47e6-aba7-4fb1-b9c4-43bbe5a7752f tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "cinder-6de1db7e-749b-4d24-80e0-b5e7849f7334-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b3d202a2-e12c-41e4-9d01-31d725a8bc32 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98" returned: 0 in 0.408s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b3d202a2-e12c-41e4-9d01-31d725a8bc32 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.c779e7fc-431f-4f50-8ba1-9dab3c1a8994 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c45d47e6-aba7-4fb1-b9c4-43bbe5a7752f tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-6de1db7e-749b-4d24-80e0-b5e7849f7334-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:44 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.c779e7fc-431f-4f50-8ba1-9dab3c1a8994 1G Sep 04 16:09:44 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c45d47e6-aba7-4fb1-b9c4-43bbe5a7752f tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "cinder-quobyte-6de1db7e-749b-4d24-80e0-b5e7849f7334" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c45d47e6-aba7-4fb1-b9c4-43bbe5a7752f tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-quobyte-6de1db7e-749b-4d24-80e0-b5e7849f7334" acquired by "delete_volume" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7092290-46d5-4166-9248-0df131c61c77]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c45d47e6-aba7-4fb1-b9c4-43bbe5a7752f tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6de1db7e-749b-4d24-80e0-b5e7849f7334 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-99fa29d9-2e18-4ae9-b464-10f04b7bc91c tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "cinder-002c1dc2-d726-4ed5-b95a-758d7f05184c-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-99fa29d9-2e18-4ae9-b464-10f04b7bc91c tempest-CreateVolumesFromImageTest-993053492 None] Lock "cinder-002c1dc2-d726-4ed5-b95a-758d7f05184c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-99fa29d9-2e18-4ae9-b464-10f04b7bc91c tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "cinder-quobyte-002c1dc2-d726-4ed5-b95a-758d7f05184c" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:44 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4a72ed28-7d88-4990-a3d7-a946303e4e27 tempest-CreateVolumesFromImageTest-993053492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.338s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-4a72ed28-7d88-4990-a3d7-a946303e4e27 tempest-CreateVolumesFromImageTest-993053492 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-99fa29d9-2e18-4ae9-b464-10f04b7bc91c tempest-CreateVolumesFromImageTest-993053492 None] Lock "cinder-quobyte-002c1dc2-d726-4ed5-b95a-758d7f05184c" acquired by "delete_volume" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:44 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-4a72ed28-7d88-4990-a3d7-a946303e4e27 tempest-CreateVolumesFromImageTest-993053492 None] Deleted volume successfully. Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2d0e8a-4d65-48b3-b0ff-781b5a99bea2]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:44 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6de1db7e-749b-4d24-80e0-b5e7849f7334 Sep 04 16:09:44 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99fa29d9-2e18-4ae9-b464-10f04b7bc91c tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-002c1dc2-d726-4ed5-b95a-758d7f05184c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-4a72ed28-7d88-4990-a3d7-a946303e4e27 tempest-CreateVolumesFromImageTest-993053492 None] Lock "cinder-6d76a8e8-fcc7-4e74-80bc-8c464717aeb1-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:44 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-002c1dc2-d726-4ed5-b95a-758d7f05184c Sep 04 16:09:44 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:44 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b3d202a2-e12c-41e4-9d01-31d725a8bc32 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.c779e7fc-431f-4f50-8ba1-9dab3c1a8994 1G" returned: 0 in 0.535s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b3d202a2-e12c-41e4-9d01-31d725a8bc32 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5300568e-06f1-4b48-92a3-655220d0ca98 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.c779e7fc-431f-4f50-8ba1-9dab3c1a8994 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:45 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5300568e-06f1-4b48-92a3-655220d0ca98 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.c779e7fc-431f-4f50-8ba1-9dab3c1a8994 Sep 04 16:09:45 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:45 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c45d47e6-aba7-4fb1-b9c4-43bbe5a7752f tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6de1db7e-749b-4d24-80e0-b5e7849f7334" returned: 0 in 0.484s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c45d47e6-aba7-4fb1-b9c4-43bbe5a7752f tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6de1db7e-749b-4d24-80e0-b5e7849f7334 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:45 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6de1db7e-749b-4d24-80e0-b5e7849f7334 Sep 04 16:09:45 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:45 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99fa29d9-2e18-4ae9-b464-10f04b7bc91c tempest-CreateVolumesFromImageTest-993053492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-002c1dc2-d726-4ed5-b95a-758d7f05184c" returned: 0 in 0.406s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99fa29d9-2e18-4ae9-b464-10f04b7bc91c tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-002c1dc2-d726-4ed5-b95a-758d7f05184c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:45 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-002c1dc2-d726-4ed5-b95a-758d7f05184c Sep 04 16:09:45 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:45 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b3d202a2-e12c-41e4-9d01-31d725a8bc32 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5300568e-06f1-4b48-92a3-655220d0ca98 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.c779e7fc-431f-4f50-8ba1-9dab3c1a8994" returned: 0 in 0.322s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:45 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-b3d202a2-e12c-41e4-9d01-31d725a8bc32 tempest-CreateVolumesFromSnapshotTest-387280520 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.c779e7fc-431f-4f50-8ba1-9dab3c1a8994 is being set with open permissions: ugo+rw Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b3d202a2-e12c-41e4-9d01-31d725a8bc32 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.c779e7fc-431f-4f50-8ba1-9dab3c1a8994 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:45 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.c779e7fc-431f-4f50-8ba1-9dab3c1a8994 Sep 04 16:09:45 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:45 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c45d47e6-aba7-4fb1-b9c4-43bbe5a7752f tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-6de1db7e-749b-4d24-80e0-b5e7849f7334" returned: 0 in 0.272s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c45d47e6-aba7-4fb1-b9c4-43bbe5a7752f tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-quobyte-6de1db7e-749b-4d24-80e0-b5e7849f7334" released by "delete_volume" :: held 0.814s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-c45d47e6-aba7-4fb1-b9c4-43bbe5a7752f tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Created reservations ['98047831-ac16-47ce-ba7e-72d6c3a3ec6c', '2a06c2a6-5ec5-42f7-a3fd-566c2d13c166', '81f15eff-e555-4bcc-9401-c8913ca7652b', '0d3ddc91-1930-4c41-978e-dc074e13534f'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:45 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99fa29d9-2e18-4ae9-b464-10f04b7bc91c tempest-CreateVolumesFromImageTest-993053492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-002c1dc2-d726-4ed5-b95a-758d7f05184c" returned: 0 in 0.289s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c45d47e6-aba7-4fb1-b9c4-43bbe5a7752f tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c45d47e6-aba7-4fb1-b9c4-43bbe5a7752f tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c45d47e6-aba7-4fb1-b9c4-43bbe5a7752f tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c45d47e6-aba7-4fb1-b9c4-43bbe5a7752f tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c45d47e6-aba7-4fb1-b9c4-43bbe5a7752f tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c45d47e6-aba7-4fb1-b9c4-43bbe5a7752f tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-99fa29d9-2e18-4ae9-b464-10f04b7bc91c tempest-CreateVolumesFromImageTest-993053492 None] Lock "cinder-quobyte-002c1dc2-d726-4ed5-b95a-758d7f05184c" released by "delete_volume" :: held 0.762s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:45 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:45 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-99fa29d9-2e18-4ae9-b464-10f04b7bc91c tempest-CreateVolumesFromImageTest-993053492 None] Created reservations ['8658c194-b807-4325-87be-6d82c6db8ddb', '01bc6905-2398-4b6e-a3fa-e1a4e2e4ee79', '58409564-f5ec-47a5-a736-fecb957c8f51', 'efbcd17b-ef3e-470e-8caa-297a5306d80c'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:45 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b3d202a2-e12c-41e4-9d01-31d725a8bc32 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.c779e7fc-431f-4f50-8ba1-9dab3c1a8994" returned: 0 in 0.289s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b3d202a2-e12c-41e4-9d01-31d725a8bc32 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-7018e5c8-6c23-40dd-a758-ff8bc04f8dc0 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "cinder-3ce45cbd-3c19-484e-b6b1-7382c631cfd8-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:45 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.info Sep 04 16:09:45 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-7018e5c8-6c23-40dd-a758-ff8bc04f8dc0 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-3ce45cbd-3c19-484e-b6b1-7382c631cfd8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-99fa29d9-2e18-4ae9-b464-10f04b7bc91c tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-99fa29d9-2e18-4ae9-b464-10f04b7bc91c tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-99fa29d9-2e18-4ae9-b464-10f04b7bc91c tempest-CreateVolumesFromImageTest-993053492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-99fa29d9-2e18-4ae9-b464-10f04b7bc91c tempest-CreateVolumesFromImageTest-993053492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-99fa29d9-2e18-4ae9-b464-10f04b7bc91c tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99fa29d9-2e18-4ae9-b464-10f04b7bc91c tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:45 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:45 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-7018e5c8-6c23-40dd-a758-ff8bc04f8dc0 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "cinder-quobyte-3ce45cbd-3c19-484e-b6b1-7382c631cfd8" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-7018e5c8-6c23-40dd-a758-ff8bc04f8dc0 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-quobyte-3ce45cbd-3c19-484e-b6b1-7382c631cfd8" acquired by "delete_volume" :: waited 0.029s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:45 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c45d47e6-aba7-4fb1-b9c4-43bbe5a7752f tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.336s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-c45d47e6-aba7-4fb1-b9c4-43bbe5a7752f tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:45 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-c45d47e6-aba7-4fb1-b9c4-43bbe5a7752f tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Deleted volume successfully. Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1a29ce-540c-4707-9054-9581029d1680]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7018e5c8-6c23-40dd-a758-ff8bc04f8dc0 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3ce45cbd-3c19-484e-b6b1-7382c631cfd8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-736b594b-d260-4d57-a9b9-90afa0b3dab6 tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "cinder-c7f4c260-21b3-4494-b338-a16ab1376ee9-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c45d47e6-aba7-4fb1-b9c4-43bbe5a7752f tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-6de1db7e-749b-4d24-80e0-b5e7849f7334-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-736b594b-d260-4d57-a9b9-90afa0b3dab6 tempest-CreateVolumesFromImageTest-993053492 None] Lock "cinder-c7f4c260-21b3-4494-b338-a16ab1376ee9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-736b594b-d260-4d57-a9b9-90afa0b3dab6 tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "cinder-quobyte-c7f4c260-21b3-4494-b338-a16ab1376ee9" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-736b594b-d260-4d57-a9b9-90afa0b3dab6 tempest-CreateVolumesFromImageTest-993053492 None] Lock "cinder-quobyte-c7f4c260-21b3-4494-b338-a16ab1376ee9" acquired by "delete_volume" :: waited 0.021s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1ef122-0f98-4087-b08a-470d3e8cfc33]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-736b594b-d260-4d57-a9b9-90afa0b3dab6 tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c7f4c260-21b3-4494-b338-a16ab1376ee9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:46 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b3d202a2-e12c-41e4-9d01-31d725a8bc32 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.info" returned: 0 in 0.403s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:46 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-b3d202a2-e12c-41e4-9d01-31d725a8bc32 tempest-CreateVolumesFromSnapshotTest-387280520 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.info is being set with open permissions: ugo+rw Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b3d202a2-e12c-41e4-9d01-31d725a8bc32 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:46 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3ce45cbd-3c19-484e-b6b1-7382c631cfd8 Sep 04 16:09:46 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:46 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.info Sep 04 16:09:46 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:46 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99fa29d9-2e18-4ae9-b464-10f04b7bc91c tempest-CreateVolumesFromImageTest-993053492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.397s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-99fa29d9-2e18-4ae9-b464-10f04b7bc91c tempest-CreateVolumesFromImageTest-993053492 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:46 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-99fa29d9-2e18-4ae9-b464-10f04b7bc91c tempest-CreateVolumesFromImageTest-993053492 None] Deleted volume successfully. Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-99fa29d9-2e18-4ae9-b464-10f04b7bc91c tempest-CreateVolumesFromImageTest-993053492 None] Lock "cinder-002c1dc2-d726-4ed5-b95a-758d7f05184c-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:46 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c7f4c260-21b3-4494-b338-a16ab1376ee9 Sep 04 16:09:46 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:46 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b3d202a2-e12c-41e4-9d01-31d725a8bc32 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.info" returned: 0 in 0.272s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b3d202a2-e12c-41e4-9d01-31d725a8bc32 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.354s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:46 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.400s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4fb216-e2c6-4f23-a088-037646086da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96931f6a82d54cf488dda0698580d86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:37Z,use_quota=True,user_id='7813f5bcf10c4a71b22ab1fd72e5c4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(805abb5b-fef1-4809-939c-738dc2720a5b),volume_type_id=805abb5b-fef1-4809-939c-738dc2720a5b)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Creating volume 9c4fb216-e2c6-4f23-a088-037646086da5 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:46 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7018e5c8-6c23-40dd-a758-ff8bc04f8dc0 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3ce45cbd-3c19-484e-b6b1-7382c631cfd8" returned: 0 in 0.516s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7018e5c8-6c23-40dd-a758-ff8bc04f8dc0 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3ce45cbd-3c19-484e-b6b1-7382c631cfd8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:46 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5 1073741824 Sep 04 16:09:46 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:46 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3ce45cbd-3c19-484e-b6b1-7382c631cfd8 Sep 04 16:09:46 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:46 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b3d202a2-e12c-41e4-9d01-31d725a8bc32 tempest-CreateVolumesFromSnapshotTest-387280520 None] Create snapshot completed successfully Sep 04 16:09:46 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-736b594b-d260-4d57-a9b9-90afa0b3dab6 tempest-CreateVolumesFromImageTest-993053492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c7f4c260-21b3-4494-b338-a16ab1376ee9" returned: 0 in 0.434s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-736b594b-d260-4d57-a9b9-90afa0b3dab6 tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c7f4c260-21b3-4494-b338-a16ab1376ee9 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:46 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c7f4c260-21b3-4494-b338-a16ab1376ee9 Sep 04 16:09:46 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:46 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7018e5c8-6c23-40dd-a758-ff8bc04f8dc0 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3ce45cbd-3c19-484e-b6b1-7382c631cfd8" returned: 0 in 0.275s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-7018e5c8-6c23-40dd-a758-ff8bc04f8dc0 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-quobyte-3ce45cbd-3c19-484e-b6b1-7382c631cfd8" released by "delete_volume" :: held 0.851s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:46 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-736b594b-d260-4d57-a9b9-90afa0b3dab6 tempest-CreateVolumesFromImageTest-993053492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c7f4c260-21b3-4494-b338-a16ab1376ee9" returned: 0 in 0.261s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-7018e5c8-6c23-40dd-a758-ff8bc04f8dc0 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Created reservations ['6716d2ce-809b-4d62-b656-f375b894cd89', '74cab8f9-4c8f-4b57-aa5b-b9d0563f9580', '00d65c45-0172-4868-b64f-ba60acd6ffdc', '6404a01c-600c-4bcb-a387-a18828a685c8'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-736b594b-d260-4d57-a9b9-90afa0b3dab6 tempest-CreateVolumesFromImageTest-993053492 None] Lock "cinder-quobyte-c7f4c260-21b3-4494-b338-a16ab1376ee9" released by "delete_volume" :: held 0.749s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7018e5c8-6c23-40dd-a758-ff8bc04f8dc0 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7018e5c8-6c23-40dd-a758-ff8bc04f8dc0 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7018e5c8-6c23-40dd-a758-ff8bc04f8dc0 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-7018e5c8-6c23-40dd-a758-ff8bc04f8dc0 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7018e5c8-6c23-40dd-a758-ff8bc04f8dc0 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7018e5c8-6c23-40dd-a758-ff8bc04f8dc0 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:46 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5 1073741824" returned: 0 in 0.503s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:46 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:46 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-74e02c49-45f8-4cbf-b384-76268a505750 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "cinder-975868c1-f8a4-4855-850c-8b14d67890c1-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-736b594b-d260-4d57-a9b9-90afa0b3dab6 tempest-CreateVolumesFromImageTest-993053492 None] Created reservations ['8301f591-7dfc-407d-9b7e-195ec24a6e56', '50845bf5-a0ed-4bc8-8b03-656788e9511a', '8afeb58d-ec42-4993-b820-bdbb2cb2232b', 'f273ae5a-dadf-4742-b9e6-f6ff235afe1a'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-74e02c49-45f8-4cbf-b384-76268a505750 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-975868c1-f8a4-4855-850c-8b14d67890c1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:46 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5 Sep 04 16:09:46 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-74e02c49-45f8-4cbf-b384-76268a505750 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "cinder-quobyte-975868c1-f8a4-4855-850c-8b14d67890c1" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-74e02c49-45f8-4cbf-b384-76268a505750 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-quobyte-975868c1-f8a4-4855-850c-8b14d67890c1" acquired by "delete_volume" :: waited 0.036s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-736b594b-d260-4d57-a9b9-90afa0b3dab6 tempest-CreateVolumesFromImageTest-993053492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-736b594b-d260-4d57-a9b9-90afa0b3dab6 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-736b594b-d260-4d57-a9b9-90afa0b3dab6 tempest-CreateVolumesFromImageTest-993053492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-736b594b-d260-4d57-a9b9-90afa0b3dab6 tempest-CreateVolumesFromImageTest-993053492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-736b594b-d260-4d57-a9b9-90afa0b3dab6 tempest-CreateVolumesFromImageTest-993053492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-736b594b-d260-4d57-a9b9-90afa0b3dab6 tempest-CreateVolumesFromImageTest-993053492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5586383-02cd-4fd6-9e3c-86c8b0935643]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-74e02c49-45f8-4cbf-b384-76268a505750 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-975868c1-f8a4-4855-850c-8b14d67890c1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:47 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:47 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:47 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7018e5c8-6c23-40dd-a758-ff8bc04f8dc0 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.383s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-7018e5c8-6c23-40dd-a758-ff8bc04f8dc0 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:47 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-7018e5c8-6c23-40dd-a758-ff8bc04f8dc0 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Deleted volume successfully. Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-7018e5c8-6c23-40dd-a758-ff8bc04f8dc0 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-3ce45cbd-3c19-484e-b6b1-7382c631cfd8-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:47 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-975868c1-f8a4-4855-850c-8b14d67890c1 Sep 04 16:09:47 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:47 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5" returned: 0 in 0.443s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Attempting download of e979f90a-fc87-45de-857c-823b91aa142e ((None, [{'url': 'file:///opt/stack/data/glance/images/e979f90a-fc87-45de-857c-823b91aa142e', 'metadata': {}}])) to volume 9c4fb216-e2c6-4f23-a088-037646086da5. {{(pid=87513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 16:09:47 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-736b594b-d260-4d57-a9b9-90afa0b3dab6 tempest-CreateVolumesFromImageTest-993053492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.409s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-736b594b-d260-4d57-a9b9-90afa0b3dab6 tempest-CreateVolumesFromImageTest-993053492 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:47 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-736b594b-d260-4d57-a9b9-90afa0b3dab6 tempest-CreateVolumesFromImageTest-993053492 None] Deleted volume successfully. Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8154b14-1776-4bbe-8255-22877e11ce05]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e979f90a-fc87-45de-857c-823b91aa142e_ko6hjidm {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-736b594b-d260-4d57-a9b9-90afa0b3dab6 tempest-CreateVolumesFromImageTest-993053492 None] Lock "cinder-c7f4c260-21b3-4494-b338-a16ab1376ee9-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:47 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e979f90a-fc87-45de-857c-823b91aa142e_ko6hjidm Sep 04 16:09:47 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:47 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-74e02c49-45f8-4cbf-b384-76268a505750 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-975868c1-f8a4-4855-850c-8b14d67890c1" returned: 0 in 0.667s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-74e02c49-45f8-4cbf-b384-76268a505750 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-975868c1-f8a4-4855-850c-8b14d67890c1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:47 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-975868c1-f8a4-4855-850c-8b14d67890c1 Sep 04 16:09:47 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:47 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e979f90a-fc87-45de-857c-823b91aa142e_ko6hjidm" returned: 0 in 0.398s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e979f90a-fc87-45de-857c-823b91aa142e_ko6hjidm {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:48 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Flow 'volume_create_manager' (710d1b62-53b0-4c7c-99b0-c6a3bf2aa300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b9b2df-b6c1-44f4-818d-46e533c7c8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-74e02c49-45f8-4cbf-b384-76268a505750 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-975868c1-f8a4-4855-850c-8b14d67890c1" returned: 0 in 0.353s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:48 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e979f90a-fc87-45de-857c-823b91aa142e_ko6hjidm Sep 04 16:09:48 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-74e02c49-45f8-4cbf-b384-76268a505750 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-quobyte-975868c1-f8a4-4855-850c-8b14d67890c1" released by "delete_volume" :: held 1.124s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b9b2df-b6c1-44f4-818d-46e533c7c8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-335487463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c86b6a6c-cb01-4998-8abd-66dd2a287ef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963ca1822b2446a0aff0adfdd256917c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:48Z,use_quota=True,user_id='60a57c8abb4744a484d009670fc1b8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e42637-2b89-4d53-806e-9bcd0ecc724d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e42637-2b89-4d53-806e-9bcd0ecc724d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4389ef7f-45cc-47cc-b819-25a9efac0404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4389ef7f-45cc-47cc-b819-25a9efac0404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c86b6a6c-cb01-4998-8abd-66dd2a287ef0', 'volume_name': 'volume-c86b6a6c-cb01-4998-8abd-66dd2a287ef0', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3975a692-4a70-466d-8fe2-4a8fdc751d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3975a692-4a70-466d-8fe2-4a8fdc751d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddee0f92-b890-4fb9-8dbb-616ad25d0149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:48 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Volume c86b6a6c-cb01-4998-8abd-66dd2a287ef0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c86b6a6c-cb01-4998-8abd-66dd2a287ef0', 'volume_size': 1} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-335487463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c86b6a6c-cb01-4998-8abd-66dd2a287ef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963ca1822b2446a0aff0adfdd256917c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:48Z,use_quota=True,user_id='60a57c8abb4744a484d009670fc1b8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Creating volume c86b6a6c-cb01-4998-8abd-66dd2a287ef0 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:48 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c86b6a6c-cb01-4998-8abd-66dd2a287ef0 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:48 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c86b6a6c-cb01-4998-8abd-66dd2a287ef0 1073741824 Sep 04 16:09:48 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-74e02c49-45f8-4cbf-b384-76268a505750 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Created reservations ['05b78796-e7b4-4e07-afcc-96c43752c230', 'c7dcdf0b-f444-427b-b906-334613ac23da', 'f44cb377-a5d6-429b-83de-b7ebdf70db9a', '50f2a656-1f1b-44ea-9ac7-0fd41a4d355d'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-74e02c49-45f8-4cbf-b384-76268a505750 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-74e02c49-45f8-4cbf-b384-76268a505750 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-74e02c49-45f8-4cbf-b384-76268a505750 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-74e02c49-45f8-4cbf-b384-76268a505750 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-74e02c49-45f8-4cbf-b384-76268a505750 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-74e02c49-45f8-4cbf-b384-76268a505750 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:48 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e979f90a-fc87-45de-857c-823b91aa142e_ko6hjidm" returned: 1 in 0.607s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e979f90a-fc87-45de-857c-823b91aa142e_ko6hjidm' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:09:48 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:48 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cfe170-ff6a-4e37-a5df-a4524cb7699d]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:48 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD Sep 04 16:09:48 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Flow 'volume_create_manager' (b8d4c813-66b5-4c55-b686-ac3f4a122257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e87133a9-5c77-4ff9-b0cb-88adf3c40f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:48 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-74e02c49-45f8-4cbf-b384-76268a505750 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.374s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-74e02c49-45f8-4cbf-b384-76268a505750 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e87133a9-5c77-4ff9-b0cb-88adf3c40f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1092552208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f45772-7ae9-49ea-bc79-31fdb3a4c2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963ca1822b2446a0aff0adfdd256917c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:49Z,use_quota=True,user_id='60a57c8abb4744a484d009670fc1b8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6a0221-a545-47d0-bbe9-bd6206133a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6a0221-a545-47d0-bbe9-bd6206133a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec13c5d-40c9-4bc8-8d35-2890da4ebe4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec13c5d-40c9-4bc8-8d35-2890da4ebe4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84f45772-7ae9-49ea-bc79-31fdb3a4c2ea', 'volume_name': 'volume-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea2ee72-99a5-44fd-ba81-c21ca28a4d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ea2ee72-99a5-44fd-ba81-c21ca28a4d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ab72df-c43d-45ab-a082-7286fde5d09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:48 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Volume 84f45772-7ae9-49ea-bc79-31fdb3a4c2ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea', 'volume_size': 1} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:48 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-74e02c49-45f8-4cbf-b384-76268a505750 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Deleted volume successfully. Sep 04 16:09:48 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-74e02c49-45f8-4cbf-b384-76268a505750 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-975868c1-f8a4-4855-850c-8b14d67890c1-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c86b6a6c-cb01-4998-8abd-66dd2a287ef0 1073741824" returned: 0 in 0.762s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c86b6a6c-cb01-4998-8abd-66dd2a287ef0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:49 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c86b6a6c-cb01-4998-8abd-66dd2a287ef0 Sep 04 16:09:49 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:49 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD" returned: 0 in 0.526s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a2fcbb97-1ad4-4198-b0c1-dda8ecd4ffcb tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "cinder-83b4412c-f6e1-4aca-af44-01b673f3b269-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:49 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD Sep 04 16:09:49 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a2fcbb97-1ad4-4198-b0c1-dda8ecd4ffcb tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-83b4412c-f6e1-4aca-af44-01b673f3b269-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a2fcbb97-1ad4-4198-b0c1-dda8ecd4ffcb tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "cinder-quobyte-83b4412c-f6e1-4aca-af44-01b673f3b269" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a2fcbb97-1ad4-4198-b0c1-dda8ecd4ffcb tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-quobyte-83b4412c-f6e1-4aca-af44-01b673f3b269" acquired by "delete_volume" :: waited 0.032s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:49 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c86b6a6c-cb01-4998-8abd-66dd2a287ef0" returned: 0 in 0.430s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0829c07c-7a74-4a38-963a-7c3a22d2db60]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.521s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1092552208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f45772-7ae9-49ea-bc79-31fdb3a4c2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963ca1822b2446a0aff0adfdd256917c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:49Z,use_quota=True,user_id='60a57c8abb4744a484d009670fc1b8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Creating volume 84f45772-7ae9-49ea-bc79-31fdb3a4c2ea {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:49 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a2fcbb97-1ad4-4198-b0c1-dda8ecd4ffcb tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-83b4412c-f6e1-4aca-af44-01b673f3b269 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:49 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea 1073741824 Sep 04 16:09:49 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Flow 'volume_create_manager' (b7fa7be6-fd11-4fe7-a8ca-d5a43dbf27f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44220bdb-1b07-4478-92f1-e266e90ba183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddee0f92-b890-4fb9-8dbb-616ad25d0149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c86b6a6c-cb01-4998-8abd-66dd2a287ef0', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:49 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca79c5e-e2db-4ecb-9516-1d15ff469d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD" returned: 1 in 0.505s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] e979f90a-fc87-45de-857c-823b91aa142e was raw, converting to raw {{(pid=87513) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:49 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-83b4412c-f6e1-4aca-af44-01b673f3b269 Sep 04 16:09:49 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44220bdb-1b07-4478-92f1-e266e90ba183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-310383310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768d4755-3d13-417b-9a17-b47811a127e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963ca1822b2446a0aff0adfdd256917c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:49Z,use_quota=True,user_id='60a57c8abb4744a484d009670fc1b8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:49 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5 Sep 04 16:09:49 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e0dce2-8462-4021-a04c-b93b8e348538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e0dce2-8462-4021-a04c-b93b8e348538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590b9c44-8524-4c19-917c-396dad0f12c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590b9c44-8524-4c19-917c-396dad0f12c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '768d4755-3d13-417b-9a17-b47811a127e1', 'volume_name': 'volume-768d4755-3d13-417b-9a17-b47811a127e1', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e3fdd3-2f60-4bb1-af10-63137503c99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e3fdd3-2f60-4bb1-af10-63137503c99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2612c14-ede9-4d39-b753-e4c8f8705d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:49 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Volume 768d4755-3d13-417b-9a17-b47811a127e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-768d4755-3d13-417b-9a17-b47811a127e1', 'volume_size': 1} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:49 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Volume volume-c86b6a6c-cb01-4998-8abd-66dd2a287ef0 (c86b6a6c-cb01-4998-8abd-66dd2a287ef0): created successfully Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca79c5e-e2db-4ecb-9516-1d15ff469d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Flow 'volume_create_manager' (710d1b62-53b0-4c7c-99b0-c6a3bf2aa300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:49 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-91241e6b-20c5-4654-91ad-4f5f0fa72b40 tempest-CreateVolumesFromSnapshotTest-387280520 None] Created volume successfully. Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Flow 'volume_create_manager' (33ca7813-ec70-4f52-a110-44273b76c8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c44c17-52c2-4d70-9d56-c8d30cfdfee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c44c17-52c2-4d70-9d56-c8d30cfdfee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1677199162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b32287ac-ebc1-4b61-9d09-81f371eb9e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963ca1822b2446a0aff0adfdd256917c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:50Z,use_quota=True,user_id='60a57c8abb4744a484d009670fc1b8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46c2729-e4c5-453a-a7a4-5690c0974256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46c2729-e4c5-453a-a7a4-5690c0974256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c634195-3be1-49b7-90ac-b6d5785255fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c634195-3be1-49b7-90ac-b6d5785255fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b32287ac-ebc1-4b61-9d09-81f371eb9e73', 'volume_name': 'volume-b32287ac-ebc1-4b61-9d09-81f371eb9e73', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6534b1da-15c7-4365-b586-189dfdcece6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6534b1da-15c7-4365-b586-189dfdcece6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479925d4-f6e6-434b-b089-2824a3426bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:50 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Volume b32287ac-ebc1-4b61-9d09-81f371eb9e73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b32287ac-ebc1-4b61-9d09-81f371eb9e73', 'volume_size': 1} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:50 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a2fcbb97-1ad4-4198-b0c1-dda8ecd4ffcb tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-83b4412c-f6e1-4aca-af44-01b673f3b269" returned: 0 in 0.656s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a2fcbb97-1ad4-4198-b0c1-dda8ecd4ffcb tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-83b4412c-f6e1-4aca-af44-01b673f3b269 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:50 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-83b4412c-f6e1-4aca-af44-01b673f3b269 Sep 04 16:09:50 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:50 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5" returned: 0 in 0.597s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e979f90a-fc87-45de-857c-823b91aa142e_p0fg244qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5 {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:09:50 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:50 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5 1G Sep 04 16:09:50 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:50 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea 1073741824" returned: 0 in 0.896s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:50 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea Sep 04 16:09:50 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Flow 'volume_create_manager' (71811c59-cf78-47c9-8569-38d23045123a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f5cede-c8a0-4145-9904-cbe97ce4b64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f5cede-c8a0-4145-9904-cbe97ce4b64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-570573929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2578f0a9-ba45-46fc-bdc6-37c8e015a499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963ca1822b2446a0aff0adfdd256917c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:50Z,use_quota=True,user_id='60a57c8abb4744a484d009670fc1b8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1faac466-da27-4d6d-b6e0-f4469afa2b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:50 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1faac466-da27-4d6d-b6e0-f4469afa2b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d28993c-8d18-4f12-a27d-a5f2b4b182f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d28993c-8d18-4f12-a27d-a5f2b4b182f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2578f0a9-ba45-46fc-bdc6-37c8e015a499', 'volume_name': 'volume-2578f0a9-ba45-46fc-bdc6-37c8e015a499', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2576b9ea-768f-45f4-bf30-dff4f6deb00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2576b9ea-768f-45f4-bf30-dff4f6deb00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7873fc95-67b5-4e8e-9d78-68d19ac9ef70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:50 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Volume 2578f0a9-ba45-46fc-bdc6-37c8e015a499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2578f0a9-ba45-46fc-bdc6-37c8e015a499', 'volume_size': 1} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a2fcbb97-1ad4-4198-b0c1-dda8ecd4ffcb tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-83b4412c-f6e1-4aca-af44-01b673f3b269" returned: 0 in 0.496s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a2fcbb97-1ad4-4198-b0c1-dda8ecd4ffcb tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-quobyte-83b4412c-f6e1-4aca-af44-01b673f3b269" released by "delete_volume" :: held 1.247s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-a2fcbb97-1ad4-4198-b0c1-dda8ecd4ffcb tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Created reservations ['2ac95a9f-ffc9-4554-8678-0aa5eb740238', 'a1a3550a-fcf7-4c36-b366-bd373eb5119a', 'b88ff42d-13ac-4322-9af2-fe6cfc869164', '13ec0268-64af-4e30-bfec-5aa257bdbefa'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:50 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5 1G" returned: 0 in 0.527s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a2fcbb97-1ad4-4198-b0c1-dda8ecd4ffcb tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a2fcbb97-1ad4-4198-b0c1-dda8ecd4ffcb tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a2fcbb97-1ad4-4198-b0c1-dda8ecd4ffcb tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:50 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a2fcbb97-1ad4-4198-b0c1-dda8ecd4ffcb tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a2fcbb97-1ad4-4198-b0c1-dda8ecd4ffcb tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a2fcbb97-1ad4-4198-b0c1-dda8ecd4ffcb tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea" returned: 0 in 0.371s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f58fda-c765-443b-924e-2a2d4c47fcea]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:50 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:50 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.106s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-310383310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768d4755-3d13-417b-9a17-b47811a127e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963ca1822b2446a0aff0adfdd256917c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:49Z,use_quota=True,user_id='60a57c8abb4744a484d009670fc1b8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Creating volume 768d4755-3d13-417b-9a17-b47811a127e1 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:50 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-768d4755-3d13-417b-9a17-b47811a127e1 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ab72df-c43d-45ab-a082-7286fde5d09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af6f724-0e5c-4bdd-a895-a15e77f0c823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:50 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-768d4755-3d13-417b-9a17-b47811a127e1 1073741824 Sep 04 16:09:50 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:50 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Volume volume-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea (84f45772-7ae9-49ea-bc79-31fdb3a4c2ea): created successfully Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af6f724-0e5c-4bdd-a895-a15e77f0c823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Flow 'volume_create_manager' (b8d4c813-66b5-4c55-b686-ac3f4a122257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:50 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-1cfc0534-334d-480f-9999-2d0acf5914b3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Created volume successfully. Sep 04 16:09:50 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5 Sep 04 16:09:50 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:51 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a2fcbb97-1ad4-4198-b0c1-dda8ecd4ffcb tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.277s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-a2fcbb97-1ad4-4198-b0c1-dda8ecd4ffcb tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:51 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-a2fcbb97-1ad4-4198-b0c1-dda8ecd4ffcb tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Deleted volume successfully. Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a2fcbb97-1ad4-4198-b0c1-dda8ecd4ffcb tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-83b4412c-f6e1-4aca-af44-01b673f3b269-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:51 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5" returned: 0 in 0.441s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:51 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-768d4755-3d13-417b-9a17-b47811a127e1 1073741824" returned: 0 in 0.500s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:51 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5 Sep 04 16:09:51 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-768d4755-3d13-417b-9a17-b47811a127e1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:51 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-768d4755-3d13-417b-9a17-b47811a127e1 Sep 04 16:09:51 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:51 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-768d4755-3d13-417b-9a17-b47811a127e1" returned: 0 in 0.358s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:51 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.605s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1677199162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b32287ac-ebc1-4b61-9d09-81f371eb9e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963ca1822b2446a0aff0adfdd256917c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:50Z,use_quota=True,user_id='60a57c8abb4744a484d009670fc1b8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Creating volume b32287ac-ebc1-4b61-9d09-81f371eb9e73 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:51 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b32287ac-ebc1-4b61-9d09-81f371eb9e73 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5" returned: 1 in 0.515s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Downloaded image e979f90a-fc87-45de-857c-823b91aa142e ((None, [{'url': 'file:///opt/stack/data/glance/images/e979f90a-fc87-45de-857c-823b91aa142e', 'metadata': {}}])) to volume 9c4fb216-e2c6-4f23-a088-037646086da5 successfully. {{(pid=87513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Temporary image e979f90a-fc87-45de-857c-823b91aa142e for user 7813f5bcf10c4a71b22ab1fd72e5c4a8 is deleted. {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Marking volume 9c4fb216-e2c6-4f23-a088-037646086da5 as bootable. {{(pid=87513) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 16:09:51 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b32287ac-ebc1-4b61-9d09-81f371eb9e73 1073741824 Sep 04 16:09:51 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Copying metadata from image e979f90a-fc87-45de-857c-823b91aa142e to 9c4fb216-e2c6-4f23-a088-037646086da5. {{(pid=87513) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Creating volume glance metadata for volume 9c4fb216-e2c6-4f23-a088-037646086da5 backed by image e979f90a-fc87-45de-857c-823b91aa142e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e979f90a-fc87-45de-857c-823b91aa142e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'da4736e7182f5dedee1f6a696b49de4e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87513) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2612c14-ede9-4d39-b753-e4c8f8705d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-768d4755-3d13-417b-9a17-b47811a127e1', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7c8aa9-bc8b-4b4d-9dc6-1ef8173174c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-cfaed26e-b7a0-4142-b283-01f342194787 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "cinder-ed811e75-f080-4ebb-814f-739d7aa50fa8-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:51 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Volume volume-768d4755-3d13-417b-9a17-b47811a127e1 (768d4755-3d13-417b-9a17-b47811a127e1): created successfully Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7c8aa9-bc8b-4b4d-9dc6-1ef8173174c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Flow 'volume_create_manager' (b7fa7be6-fd11-4fe7-a8ca-d5a43dbf27f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-cfaed26e-b7a0-4142-b283-01f342194787 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-ed811e75-f080-4ebb-814f-739d7aa50fa8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Flow 'volume_create_manager' (d65b1ae8-ef8f-4fac-9caf-089d44c50512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8836a63e-2b71-4398-8672-079c7fea68f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:51 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-479b1a92-eb99-42ab-a858-ec5c85038220 tempest-CreateVolumesFromSnapshotTest-387280520 None] Created volume successfully. Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8836a63e-2b71-4398-8672-079c7fea68f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-320787514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=616a7018-db38-481b-9420-2187678bbbee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac1458cd2cc4a98bf9ab3b373f0da98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:52Z,use_quota=True,user_id='bd9c185eee0a4f3495c595216a6d093c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e937e8a6-bb7f-43a4-b407-48f6b6cd260e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e937e8a6-bb7f-43a4-b407-48f6b6cd260e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488921a5-4829-413c-87a7-30ce6d12ef09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488921a5-4829-413c-87a7-30ce6d12ef09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '616a7018-db38-481b-9420-2187678bbbee', 'volume_name': 'volume-616a7018-db38-481b-9420-2187678bbbee', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4ccfd2-b0a8-4d79-8bbd-97d39958647f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4ccfd2-b0a8-4d79-8bbd-97d39958647f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d1ac73-bfaa-4b11-8bcf-a6cc50352e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:52 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Volume 616a7018-db38-481b-9420-2187678bbbee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-616a7018-db38-481b-9420-2187678bbbee', 'volume_size': 1} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-cfaed26e-b7a0-4142-b283-01f342194787 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "cinder-quobyte-ed811e75-f080-4ebb-814f-739d7aa50fa8" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc62578-b423-4959-be70-8b4c6c44324f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c4fb216-e2c6-4f23-a088-037646086da5', 'volume_size': 1, 'image_id': 'e979f90a-fc87-45de-857c-823b91aa142e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e979f90a-fc87-45de-857c-823b91aa142e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da4736e7182f5dedee1f6a696b49de4e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '96931f6a82d54cf488dda0698580d86b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed5739341399f70f283d03694aa936561d72285e9a5e5845729bc9ddabb64b179129cdabbe7a90e640f7ba5fe322c7f8b3dc1e24727366d6c20b8bf48bb76ddf', 'id': 'e979f90a-fc87-45de-857c-823b91aa142e', 'created_at': datetime.datetime(2026, 9, 4, 14, 9, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 9, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e979f90a-fc87-45de-857c-823b91aa142e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db09f5f-e4ea-498c-930b-8548aa50b5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-cfaed26e-b7a0-4142-b283-01f342194787 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-quobyte-ed811e75-f080-4ebb-814f-739d7aa50fa8" acquired by "delete_volume" :: waited 0.034s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:52 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Volume volume-9c4fb216-e2c6-4f23-a088-037646086da5 (9c4fb216-e2c6-4f23-a088-037646086da5): created successfully Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db09f5f-e4ea-498c-930b-8548aa50b5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Flow 'volume_create_manager' (c008fa53-c99b-45d4-b9ca-0e1cb67fda45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee77151-9c0d-476b-b227-b195c9d10c7d]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-cfaed26e-b7a0-4142-b283-01f342194787 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ed811e75-f080-4ebb-814f-739d7aa50fa8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:52 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-34432c03-35c5-4028-87fd-fdd816282ad4 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Created volume successfully. Sep 04 16:09:52 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b32287ac-ebc1-4b61-9d09-81f371eb9e73 1073741824" returned: 0 in 0.490s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:52 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ed811e75-f080-4ebb-814f-739d7aa50fa8 Sep 04 16:09:52 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b32287ac-ebc1-4b61-9d09-81f371eb9e73 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:52 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b32287ac-ebc1-4b61-9d09-81f371eb9e73 Sep 04 16:09:52 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:52 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-cfaed26e-b7a0-4142-b283-01f342194787 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ed811e75-f080-4ebb-814f-739d7aa50fa8" returned: 0 in 0.377s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-cfaed26e-b7a0-4142-b283-01f342194787 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ed811e75-f080-4ebb-814f-739d7aa50fa8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:52 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b32287ac-ebc1-4b61-9d09-81f371eb9e73" returned: 0 in 0.267s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.914s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-570573929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2578f0a9-ba45-46fc-bdc6-37c8e015a499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963ca1822b2446a0aff0adfdd256917c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:50Z,use_quota=True,user_id='60a57c8abb4744a484d009670fc1b8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Creating volume 2578f0a9-ba45-46fc-bdc6-37c8e015a499 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:52 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ed811e75-f080-4ebb-814f-739d7aa50fa8 Sep 04 16:09:52 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:52 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2578f0a9-ba45-46fc-bdc6-37c8e015a499 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:52 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2578f0a9-ba45-46fc-bdc6-37c8e015a499 1073741824 Sep 04 16:09:52 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479925d4-f6e6-434b-b089-2824a3426bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b32287ac-ebc1-4b61-9d09-81f371eb9e73', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d98a09-55d7-4ee2-b1ab-034ecdcb1da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:52 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Volume volume-b32287ac-ebc1-4b61-9d09-81f371eb9e73 (b32287ac-ebc1-4b61-9d09-81f371eb9e73): created successfully Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d98a09-55d7-4ee2-b1ab-034ecdcb1da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Flow 'volume_create_manager' (33ca7813-ec70-4f52-a110-44273b76c8f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:52 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-33975a86-5a27-42bb-8aa7-1b2d0b6cd306 tempest-CreateVolumesFromSnapshotTest-387280520 None] Created volume successfully. Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Acquiring lock "cinder-9c4fb216-e2c6-4f23-a088-037646086da5-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Lock "cinder-9c4fb216-e2c6-4f23-a088-037646086da5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:52 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-cfaed26e-b7a0-4142-b283-01f342194787 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-ed811e75-f080-4ebb-814f-739d7aa50fa8" returned: 0 in 0.316s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-cfaed26e-b7a0-4142-b283-01f342194787 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-quobyte-ed811e75-f080-4ebb-814f-739d7aa50fa8" released by "delete_volume" :: held 0.743s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Acquiring lock "cinder-quobyte-9c4fb216-e2c6-4f23-a088-037646086da5" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Lock "cinder-quobyte-9c4fb216-e2c6-4f23-a088-037646086da5" acquired by "delete_volume" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-cfaed26e-b7a0-4142-b283-01f342194787 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Created reservations ['c0f6d99f-ae2d-4fdc-8921-364d7944da2a', 'a256754b-91f1-48ee-8525-847f89083058', '027fb786-33c1-4e19-9ba1-c609c36f0441', 'ceddcb25-7c1c-4a81-a64e-ef3f4b4f6b08'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0169bede-1b5a-4ebb-b94a-da04a0661cda]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-cfaed26e-b7a0-4142-b283-01f342194787 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-cfaed26e-b7a0-4142-b283-01f342194787 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-cfaed26e-b7a0-4142-b283-01f342194787 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-cfaed26e-b7a0-4142-b283-01f342194787 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-cfaed26e-b7a0-4142-b283-01f342194787 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-cfaed26e-b7a0-4142-b283-01f342194787 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:53 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:53 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:53 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2578f0a9-ba45-46fc-bdc6-37c8e015a499 1073741824" returned: 0 in 0.516s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:53 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5 Sep 04 16:09:53 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2578f0a9-ba45-46fc-bdc6-37c8e015a499 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:53 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2578f0a9-ba45-46fc-bdc6-37c8e015a499 Sep 04 16:09:53 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:53 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-cfaed26e-b7a0-4142-b283-01f342194787 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.242s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-cfaed26e-b7a0-4142-b283-01f342194787 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:53 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-cfaed26e-b7a0-4142-b283-01f342194787 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Deleted volume successfully. Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-cfaed26e-b7a0-4142-b283-01f342194787 tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-ed811e75-f080-4ebb-814f-739d7aa50fa8-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:53 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:53 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5" returned: 0 in 0.380s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2578f0a9-ba45-46fc-bdc6-37c8e015a499" returned: 0 in 0.256s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.332s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-320787514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=616a7018-db38-481b-9420-2187678bbbee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac1458cd2cc4a98bf9ab3b373f0da98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:52Z,use_quota=True,user_id='bd9c185eee0a4f3495c595216a6d093c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Creating volume 616a7018-db38-481b-9420-2187678bbbee {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:53 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7873fc95-67b5-4e8e-9d78-68d19ac9ef70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2578f0a9-ba45-46fc-bdc6-37c8e015a499', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62bd67b1-bd3b-4f7e-be84-067fb89f8a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:53 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee 1073741824 Sep 04 16:09:53 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:53 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Volume volume-2578f0a9-ba45-46fc-bdc6-37c8e015a499 (2578f0a9-ba45-46fc-bdc6-37c8e015a499): created successfully Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62bd67b1-bd3b-4f7e-be84-067fb89f8a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Flow 'volume_create_manager' (71811c59-cf78-47c9-8569-38d23045123a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:53 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-43d8049e-7b59-4aab-8287-9a6372d449a6 tempest-CreateVolumesFromSnapshotTest-387280520 None] Created volume successfully. Sep 04 16:09:53 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5 Sep 04 16:09:53 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:53 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5" returned: 1 in 0.345s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:53 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5 Sep 04 16:09:53 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:53 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee 1073741824" returned: 0 in 0.426s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:53 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee Sep 04 16:09:53 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:53 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e2757d1d-6103-4d80-947a-9ba3bc4aec91 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "cinder-2578f0a9-ba45-46fc-bdc6-37c8e015a499-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-9c4fb216-e2c6-4f23-a088-037646086da5" returned: 0 in 0.280s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e2757d1d-6103-4d80-947a-9ba3bc4aec91 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-2578f0a9-ba45-46fc-bdc6-37c8e015a499-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Lock "cinder-quobyte-9c4fb216-e2c6-4f23-a088-037646086da5" released by "delete_volume" :: held 1.112s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e2757d1d-6103-4d80-947a-9ba3bc4aec91 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "cinder-quobyte-2578f0a9-ba45-46fc-bdc6-37c8e015a499" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e83f05f5-edb3-40a0-9126-5eecfc65663d tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "cinder-67eaa988-66e8-44ab-9a53-7b5d9754e7b2-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e2757d1d-6103-4d80-947a-9ba3bc4aec91 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-quobyte-2578f0a9-ba45-46fc-bdc6-37c8e015a499" acquired by "delete_volume" :: waited 0.037s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:54 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e83f05f5-edb3-40a0-9126-5eecfc65663d tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-67eaa988-66e8-44ab-9a53-7b5d9754e7b2-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee" returned: 0 in 0.297s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfbc0af-0e00-4e43-955a-45dc31198c6a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e2757d1d-6103-4d80-947a-9ba3bc4aec91 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2578f0a9-ba45-46fc-bdc6-37c8e015a499 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d1ac73-bfaa-4b11-8bcf-a6cc50352e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-616a7018-db38-481b-9420-2187678bbbee', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f816e74-76ae-4e33-b5af-106de70bbf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Created reservations ['e283e5f1-bab0-4878-9df5-41011faed395', '81922e7b-cf50-4518-8d03-c60e43adaf08', 'b223dd25-a990-4717-9f62-eba34ab22327', 'bbda9d44-6a6a-40a0-b5c2-3afd1c75c269'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e83f05f5-edb3-40a0-9126-5eecfc65663d tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "cinder-quobyte-67eaa988-66e8-44ab-9a53-7b5d9754e7b2" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:54 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Volume volume-616a7018-db38-481b-9420-2187678bbbee (616a7018-db38-481b-9420-2187678bbbee): created successfully Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f816e74-76ae-4e33-b5af-106de70bbf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Flow 'volume_create_manager' (d65b1ae8-ef8f-4fac-9caf-089d44c50512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:54 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-0fbf7f3d-06ef-4e43-8652-3fac16523f6d tempest-VolumeDependencyTests-1373003075 None] Created volume successfully. Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e83f05f5-edb3-40a0-9126-5eecfc65663d tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-quobyte-67eaa988-66e8-44ab-9a53-7b5d9754e7b2" acquired by "delete_volume" :: waited 0.043s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:54 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2578f0a9-ba45-46fc-bdc6-37c8e015a499 Sep 04 16:09:54 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[79901192-6e75-4d81-98c7-724458f3d8da]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e83f05f5-edb3-40a0-9126-5eecfc65663d tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67eaa988-66e8-44ab-9a53-7b5d9754e7b2 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:54 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:54 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:54 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67eaa988-66e8-44ab-9a53-7b5d9754e7b2 Sep 04 16:09:54 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:54 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e2757d1d-6103-4d80-947a-9ba3bc4aec91 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2578f0a9-ba45-46fc-bdc6-37c8e015a499" returned: 0 in 0.357s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e2757d1d-6103-4d80-947a-9ba3bc4aec91 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2578f0a9-ba45-46fc-bdc6-37c8e015a499 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:54 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2578f0a9-ba45-46fc-bdc6-37c8e015a499 Sep 04 16:09:54 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:54 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.266s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:54 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Deleted volume successfully. Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-66376533-7844-48ee-9966-2e9859a7e169 tempest-VolumeAndVolumeTypeFromImageTest-1325443219 None] Lock "cinder-9c4fb216-e2c6-4f23-a088-037646086da5-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:54 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e83f05f5-edb3-40a0-9126-5eecfc65663d tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67eaa988-66e8-44ab-9a53-7b5d9754e7b2" returned: 0 in 0.402s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e83f05f5-edb3-40a0-9126-5eecfc65663d tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67eaa988-66e8-44ab-9a53-7b5d9754e7b2 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:54 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67eaa988-66e8-44ab-9a53-7b5d9754e7b2 Sep 04 16:09:54 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:54 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e2757d1d-6103-4d80-947a-9ba3bc4aec91 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2578f0a9-ba45-46fc-bdc6-37c8e015a499" returned: 0 in 0.252s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e2757d1d-6103-4d80-947a-9ba3bc4aec91 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-quobyte-2578f0a9-ba45-46fc-bdc6-37c8e015a499" released by "delete_volume" :: held 0.660s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-e2757d1d-6103-4d80-947a-9ba3bc4aec91 tempest-CreateVolumesFromSnapshotTest-387280520 None] Created reservations ['01d132c5-34d6-4f29-acd9-ed38637920d2', 'fe0e2e76-51d1-4d58-9fe6-7bee0a9d5847', 'd7ead6c8-6bd5-422a-9dfb-0c706aa84ff5', '4734629a-4076-45b0-ad9a-14f1a20e1112'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e2757d1d-6103-4d80-947a-9ba3bc4aec91 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e2757d1d-6103-4d80-947a-9ba3bc4aec91 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e2757d1d-6103-4d80-947a-9ba3bc4aec91 tempest-CreateVolumesFromSnapshotTest-387280520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e2757d1d-6103-4d80-947a-9ba3bc4aec91 tempest-CreateVolumesFromSnapshotTest-387280520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e2757d1d-6103-4d80-947a-9ba3bc4aec91 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e2757d1d-6103-4d80-947a-9ba3bc4aec91 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:54 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:54 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:54 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e83f05f5-edb3-40a0-9126-5eecfc65663d tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-67eaa988-66e8-44ab-9a53-7b5d9754e7b2" returned: 0 in 0.255s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e83f05f5-edb3-40a0-9126-5eecfc65663d tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-quobyte-67eaa988-66e8-44ab-9a53-7b5d9754e7b2" released by "delete_volume" :: held 0.707s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-e83f05f5-edb3-40a0-9126-5eecfc65663d tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Created reservations ['46f2cf1b-a7f5-46aa-9f99-0df29c801816', 'caa52edf-6df4-4cd9-a38b-43ba1b123c97', 'edf731c2-5d29-4341-9e84-0e28f805d88e', 'de76bf18-65a1-44a1-9317-dcef48a29967'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e83f05f5-edb3-40a0-9126-5eecfc65663d tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e83f05f5-edb3-40a0-9126-5eecfc65663d tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e83f05f5-edb3-40a0-9126-5eecfc65663d tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e83f05f5-edb3-40a0-9126-5eecfc65663d tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e83f05f5-edb3-40a0-9126-5eecfc65663d tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e83f05f5-edb3-40a0-9126-5eecfc65663d tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:55 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:55 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3f3af6aa-a2ea-4e1f-9532-1f9f21b0af1d tempest-VolumeDependencyTests-1373003075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3f3af6aa-a2ea-4e1f-9532-1f9f21b0af1d tempest-VolumeDependencyTests-1373003075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-3f3af6aa-a2ea-4e1f-9532-1f9f21b0af1d tempest-VolumeDependencyTests-1373003075 None] Creating offline snapshot 4000e429-0b21-4990-be30-e1c7177ed73f of volume 616a7018-db38-481b-9420-2187678bbbee {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c63d1bdf-2e83-499c-b0f5-d4b486e3958e tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "cinder-b32287ac-ebc1-4b61-9d09-81f371eb9e73-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[482050b1-2048-4825-93ca-d3ef216000d7]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f3af6aa-a2ea-4e1f-9532-1f9f21b0af1d tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c63d1bdf-2e83-499c-b0f5-d4b486e3958e tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-b32287ac-ebc1-4b61-9d09-81f371eb9e73-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:55 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e2757d1d-6103-4d80-947a-9ba3bc4aec91 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.453s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-e2757d1d-6103-4d80-947a-9ba3bc4aec91 tempest-CreateVolumesFromSnapshotTest-387280520 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c63d1bdf-2e83-499c-b0f5-d4b486e3958e tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "cinder-quobyte-b32287ac-ebc1-4b61-9d09-81f371eb9e73" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:55 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e2757d1d-6103-4d80-947a-9ba3bc4aec91 tempest-CreateVolumesFromSnapshotTest-387280520 None] Deleted volume successfully. Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c63d1bdf-2e83-499c-b0f5-d4b486e3958e tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-quobyte-b32287ac-ebc1-4b61-9d09-81f371eb9e73" acquired by "delete_volume" :: waited 0.057s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e2757d1d-6103-4d80-947a-9ba3bc4aec91 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-2578f0a9-ba45-46fc-bdc6-37c8e015a499-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dbfb90-29e2-4d34-8b1b-a4005a696ef6]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c63d1bdf-2e83-499c-b0f5-d4b486e3958e tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b32287ac-ebc1-4b61-9d09-81f371eb9e73 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:55 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee Sep 04 16:09:55 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:55 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e83f05f5-edb3-40a0-9126-5eecfc65663d tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.417s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-e83f05f5-edb3-40a0-9126-5eecfc65663d tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:55 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e83f05f5-edb3-40a0-9126-5eecfc65663d tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Deleted volume successfully. Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e83f05f5-edb3-40a0-9126-5eecfc65663d tempest-CreateVolumesFromSourceVolumeTest-1399927194 None] Lock "cinder-67eaa988-66e8-44ab-9a53-7b5d9754e7b2-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:55 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b32287ac-ebc1-4b61-9d09-81f371eb9e73 Sep 04 16:09:55 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:55 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f3af6aa-a2ea-4e1f-9532-1f9f21b0af1d tempest-VolumeDependencyTests-1373003075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee" returned: 0 in 0.548s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f3af6aa-a2ea-4e1f-9532-1f9f21b0af1d tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:55 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f 1G Sep 04 16:09:55 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:55 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c63d1bdf-2e83-499c-b0f5-d4b486e3958e tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b32287ac-ebc1-4b61-9d09-81f371eb9e73" returned: 0 in 0.469s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c63d1bdf-2e83-499c-b0f5-d4b486e3958e tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b32287ac-ebc1-4b61-9d09-81f371eb9e73 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:55 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b32287ac-ebc1-4b61-9d09-81f371eb9e73 Sep 04 16:09:55 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:56 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c63d1bdf-2e83-499c-b0f5-d4b486e3958e tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b32287ac-ebc1-4b61-9d09-81f371eb9e73" returned: 0 in 0.328s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c63d1bdf-2e83-499c-b0f5-d4b486e3958e tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-quobyte-b32287ac-ebc1-4b61-9d09-81f371eb9e73" released by "delete_volume" :: held 0.886s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:56 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f3af6aa-a2ea-4e1f-9532-1f9f21b0af1d tempest-VolumeDependencyTests-1373003075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f 1G" returned: 0 in 0.502s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f3af6aa-a2ea-4e1f-9532-1f9f21b0af1d tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-616a7018-db38-481b-9420-2187678bbbee -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:56 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-616a7018-db38-481b-9420-2187678bbbee -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f Sep 04 16:09:56 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:56 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-c63d1bdf-2e83-499c-b0f5-d4b486e3958e tempest-CreateVolumesFromSnapshotTest-387280520 None] Created reservations ['c9252188-b502-4f83-8875-6662ad394079', '92118e28-c9ce-4df2-9e19-aefd4d513b2b', '0ff3d93a-5cba-40e1-9a7c-ed165e8c6398', '2ec3ea55-6985-41d0-a197-c02757acc8d2'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c63d1bdf-2e83-499c-b0f5-d4b486e3958e tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c63d1bdf-2e83-499c-b0f5-d4b486e3958e tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c63d1bdf-2e83-499c-b0f5-d4b486e3958e tempest-CreateVolumesFromSnapshotTest-387280520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c63d1bdf-2e83-499c-b0f5-d4b486e3958e tempest-CreateVolumesFromSnapshotTest-387280520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c63d1bdf-2e83-499c-b0f5-d4b486e3958e tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c63d1bdf-2e83-499c-b0f5-d4b486e3958e tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:56 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:56 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:56 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f3af6aa-a2ea-4e1f-9532-1f9f21b0af1d tempest-VolumeDependencyTests-1373003075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-616a7018-db38-481b-9420-2187678bbbee -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f" returned: 0 in 0.392s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:56 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-3f3af6aa-a2ea-4e1f-9532-1f9f21b0af1d tempest-VolumeDependencyTests-1373003075 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f is being set with open permissions: ugo+rw Sep 04 16:09:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f3af6aa-a2ea-4e1f-9532-1f9f21b0af1d tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:56 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f Sep 04 16:09:56 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:56 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c63d1bdf-2e83-499c-b0f5-d4b486e3958e tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.338s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:56 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-c63d1bdf-2e83-499c-b0f5-d4b486e3958e tempest-CreateVolumesFromSnapshotTest-387280520 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:56 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-c63d1bdf-2e83-499c-b0f5-d4b486e3958e tempest-CreateVolumesFromSnapshotTest-387280520 None] Deleted volume successfully. Sep 04 16:09:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c63d1bdf-2e83-499c-b0f5-d4b486e3958e tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-b32287ac-ebc1-4b61-9d09-81f371eb9e73-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:57 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f3af6aa-a2ea-4e1f-9532-1f9f21b0af1d tempest-VolumeDependencyTests-1373003075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f" returned: 0 in 0.304s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f3af6aa-a2ea-4e1f-9532-1f9f21b0af1d tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:57 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.info Sep 04 16:09:57 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:57 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f3af6aa-a2ea-4e1f-9532-1f9f21b0af1d tempest-VolumeDependencyTests-1373003075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.info" returned: 0 in 0.264s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:57 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-3f3af6aa-a2ea-4e1f-9532-1f9f21b0af1d tempest-VolumeDependencyTests-1373003075 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.info is being set with open permissions: ugo+rw Sep 04 16:09:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f3af6aa-a2ea-4e1f-9532-1f9f21b0af1d tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:57 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.info Sep 04 16:09:57 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:57 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f3af6aa-a2ea-4e1f-9532-1f9f21b0af1d tempest-VolumeDependencyTests-1373003075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.info" returned: 0 in 0.320s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3f3af6aa-a2ea-4e1f-9532-1f9f21b0af1d tempest-VolumeDependencyTests-1373003075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.477s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b69d765a-0c33-4b9d-9717-739f41d722e3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "cinder-768d4755-3d13-417b-9a17-b47811a127e1-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b69d765a-0c33-4b9d-9717-739f41d722e3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-768d4755-3d13-417b-9a17-b47811a127e1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:57 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-3f3af6aa-a2ea-4e1f-9532-1f9f21b0af1d tempest-VolumeDependencyTests-1373003075 None] Create snapshot completed successfully Sep 04 16:09:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b69d765a-0c33-4b9d-9717-739f41d722e3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "cinder-quobyte-768d4755-3d13-417b-9a17-b47811a127e1" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b69d765a-0c33-4b9d-9717-739f41d722e3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-quobyte-768d4755-3d13-417b-9a17-b47811a127e1" acquired by "delete_volume" :: waited 0.023s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:57 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fd4d37-34dc-44cf-b25f-c88eed77d9f3]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b69d765a-0c33-4b9d-9717-739f41d722e3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-768d4755-3d13-417b-9a17-b47811a127e1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:57 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-768d4755-3d13-417b-9a17-b47811a127e1 Sep 04 16:09:57 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:58 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b69d765a-0c33-4b9d-9717-739f41d722e3 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-768d4755-3d13-417b-9a17-b47811a127e1" returned: 0 in 0.464s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b69d765a-0c33-4b9d-9717-739f41d722e3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-768d4755-3d13-417b-9a17-b47811a127e1 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:58 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-768d4755-3d13-417b-9a17-b47811a127e1 Sep 04 16:09:58 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:58 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b69d765a-0c33-4b9d-9717-739f41d722e3 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-768d4755-3d13-417b-9a17-b47811a127e1" returned: 0 in 0.356s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:58 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b69d765a-0c33-4b9d-9717-739f41d722e3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-quobyte-768d4755-3d13-417b-9a17-b47811a127e1" released by "delete_volume" :: held 0.882s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:58 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-b69d765a-0c33-4b9d-9717-739f41d722e3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Created reservations ['cd3c55e5-7300-4d22-851c-b96fceaebad8', '7e8727d1-cbaf-491a-9473-df466deeb8fe', '78ddc1cc-d957-4028-99f7-f92803cf12b8', 'ffab6a32-bc2b-400e-89d7-bdf9628d2796'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b69d765a-0c33-4b9d-9717-739f41d722e3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b69d765a-0c33-4b9d-9717-739f41d722e3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b69d765a-0c33-4b9d-9717-739f41d722e3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-b69d765a-0c33-4b9d-9717-739f41d722e3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b69d765a-0c33-4b9d-9717-739f41d722e3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b69d765a-0c33-4b9d-9717-739f41d722e3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:58 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:09:58 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Flow 'volume_create_manager' (cfa37f59-37c6-47e4-b700-04eaf0e99974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684e697f-9461-447b-8fda-8bedf2a7edd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684e697f-9461-447b-8fda-8bedf2a7edd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1907655287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87436742-9c1d-4725-9392-375fe1d871b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac1458cd2cc4a98bf9ab3b373f0da98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4000e429-0b21-4990-be30-e1c7177ed73f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:59Z,use_quota=True,user_id='bd9c185eee0a4f3495c595216a6d093c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82769468-5e4d-44ac-bfc0-60d283e76ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82769468-5e4d-44ac-bfc0-60d283e76ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea8d6be-233b-424a-912d-53cff70acfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea8d6be-233b-424a-912d-53cff70acfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '87436742-9c1d-4725-9392-375fe1d871b7', 'volume_name': 'volume-87436742-9c1d-4725-9392-375fe1d871b7', 'volume_size': 1, 'snapshot_id': '4000e429-0b21-4990-be30-e1c7177ed73f'}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51afda5e-32cd-4626-9218-a2bddeff9657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51afda5e-32cd-4626-9218-a2bddeff9657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf2075f-cfaf-4fb4-84da-55012f719f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:59 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Volume 87436742-9c1d-4725-9392-375fe1d871b7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-87436742-9c1d-4725-9392-375fe1d871b7', 'volume_size': 1, 'snapshot_id': '4000e429-0b21-4990-be30-e1c7177ed73f'} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Acquiring lock "cinder-quobyte-4000e429-0b21-4990-be30-e1c7177ed73f-87436742-9c1d-4725-9392-375fe1d871b7" by "_create_volume_from_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Lock "cinder-quobyte-4000e429-0b21-4990-be30-e1c7177ed73f-87436742-9c1d-4725-9392-375fe1d871b7" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Creating volume 87436742-9c1d-4725-9392-375fe1d871b7 from snapshot 4000e429-0b21-4990-be30-e1c7177ed73f {{(pid=87513) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Acquiring lock "cinder-quobyte-87436742-9c1d-4725-9392-375fe1d871b7" by "_copy_volume_from_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Lock "cinder-quobyte-87436742-9c1d-4725-9392-375fe1d871b7" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] snapshot: 4000e429-0b21-4990-be30-e1c7177ed73f, volume: 87436742-9c1d-4725-9392-375fe1d871b7, {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 04 16:09:59 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b69d765a-0c33-4b9d-9717-739f41d722e3 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.316s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-b69d765a-0c33-4b9d-9717-739f41d722e3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:59 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b69d765a-0c33-4b9d-9717-739f41d722e3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Deleted volume successfully. Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb31c62-a79f-43d0-bf74-a3f607ac03be]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b69d765a-0c33-4b9d-9717-739f41d722e3 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-768d4755-3d13-417b-9a17-b47811a127e1-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:59 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f Sep 04 16:09:59 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:59 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f" returned: 0 in 0.434s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-616a7018-db38-481b-9420-2187678bbbee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] will copy from snapshot at /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Creating direct copy from snapshot {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3061ec9-4370-4a3d-a036-9b0d4a081160]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:59 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee Sep 04 16:09:59 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a8c98e35-3b72-4fb9-9678-5deccd87f134 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "cinder-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a8c98e35-3b72-4fb9-9678-5deccd87f134 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a8c98e35-3b72-4fb9-9678-5deccd87f134 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "cinder-quobyte-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a8c98e35-3b72-4fb9-9678-5deccd87f134 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-quobyte-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea" acquired by "delete_volume" :: waited 0.023s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:00 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf0ad21-d552-40f7-ac68-a20f4cb6c4e5]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a8c98e35-3b72-4fb9-9678-5deccd87f134 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:00 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee" returned: 0 in 0.459s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:00 devstack cinder-volume[87513]: DEBUG cinder.utils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Path /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87436742-9c1d-4725-9392-375fe1d871b7 not found in is_blk_device check {{(pid=87513) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 04 16:10:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87436742-9c1d-4725-9392-375fe1d871b7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:00 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87436742-9c1d-4725-9392-375fe1d871b7 Sep 04 16:10:00 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:00 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea Sep 04 16:10:00 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:00 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a8c98e35-3b72-4fb9-9678-5deccd87f134 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea" returned: 0 in 0.478s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a8c98e35-3b72-4fb9-9678-5deccd87f134 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:00 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea Sep 04 16:10:00 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:00 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a8c98e35-3b72-4fb9-9678-5deccd87f134 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea" returned: 0 in 0.283s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a8c98e35-3b72-4fb9-9678-5deccd87f134 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-quobyte-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea" released by "delete_volume" :: held 0.833s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:01 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-a8c98e35-3b72-4fb9-9678-5deccd87f134 tempest-CreateVolumesFromSnapshotTest-387280520 None] Created reservations ['b3b69f1c-0700-4685-b939-0e5c9139e4b1', 'c29ced76-57b9-446a-9c3e-308c14b3fa22', '313c3222-a0af-43c3-ac33-f8a20a5b74c8', 'f4f503c5-dfbf-4eba-9fd5-8ccbee62063b'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a8c98e35-3b72-4fb9-9678-5deccd87f134 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a8c98e35-3b72-4fb9-9678-5deccd87f134 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:01 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a8c98e35-3b72-4fb9-9678-5deccd87f134 tempest-CreateVolumesFromSnapshotTest-387280520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:01 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-a8c98e35-3b72-4fb9-9678-5deccd87f134 tempest-CreateVolumesFromSnapshotTest-387280520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-a8c98e35-3b72-4fb9-9678-5deccd87f134 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a8c98e35-3b72-4fb9-9678-5deccd87f134 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:01 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:10:01 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3305958a-4077-489b-b204-a45274c3015e tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "cinder-c86b6a6c-cb01-4998-8abd-66dd2a287ef0-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3305958a-4077-489b-b204-a45274c3015e tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-c86b6a6c-cb01-4998-8abd-66dd2a287ef0-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3305958a-4077-489b-b204-a45274c3015e tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "cinder-quobyte-c86b6a6c-cb01-4998-8abd-66dd2a287ef0" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3305958a-4077-489b-b204-a45274c3015e tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-quobyte-c86b6a6c-cb01-4998-8abd-66dd2a287ef0" acquired by "delete_volume" :: waited 0.031s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:01 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a8c98e35-3b72-4fb9-9678-5deccd87f134 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.552s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:01 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-a8c98e35-3b72-4fb9-9678-5deccd87f134 tempest-CreateVolumesFromSnapshotTest-387280520 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:10:01 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-a8c98e35-3b72-4fb9-9678-5deccd87f134 tempest-CreateVolumesFromSnapshotTest-387280520 None] Deleted volume successfully. Sep 04 16:10:01 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9db870-cf0a-4fab-93d7-ec9863235ba5]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3305958a-4077-489b-b204-a45274c3015e tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c86b6a6c-cb01-4998-8abd-66dd2a287ef0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a8c98e35-3b72-4fb9-9678-5deccd87f134 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-84f45772-7ae9-49ea-bc79-31fdb3a4c2ea-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:02 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c86b6a6c-cb01-4998-8abd-66dd2a287ef0 Sep 04 16:10:02 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:02 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3305958a-4077-489b-b204-a45274c3015e tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c86b6a6c-cb01-4998-8abd-66dd2a287ef0" returned: 0 in 1.065s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3305958a-4077-489b-b204-a45274c3015e tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c86b6a6c-cb01-4998-8abd-66dd2a287ef0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:02 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c86b6a6c-cb01-4998-8abd-66dd2a287ef0 Sep 04 16:10:02 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:03 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3305958a-4077-489b-b204-a45274c3015e tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-c86b6a6c-cb01-4998-8abd-66dd2a287ef0" returned: 0 in 0.590s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3305958a-4077-489b-b204-a45274c3015e tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-quobyte-c86b6a6c-cb01-4998-8abd-66dd2a287ef0" released by "delete_volume" :: held 1.756s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:03 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-3305958a-4077-489b-b204-a45274c3015e tempest-CreateVolumesFromSnapshotTest-387280520 None] Created reservations ['481216ce-d7e7-40f0-8d1b-57b986c00ba9', 'c3eec5eb-c720-48c9-abe7-b5c24df518f5', '37326871-4e98-4e97-bdef-a57a0e7fe513', '7554024d-91a4-49c0-909b-16642693ba43'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3305958a-4077-489b-b204-a45274c3015e tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3305958a-4077-489b-b204-a45274c3015e tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3305958a-4077-489b-b204-a45274c3015e tempest-CreateVolumesFromSnapshotTest-387280520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3305958a-4077-489b-b204-a45274c3015e tempest-CreateVolumesFromSnapshotTest-387280520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3305958a-4077-489b-b204-a45274c3015e tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3305958a-4077-489b-b204-a45274c3015e tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:03 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:10:03 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:04 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "cinder-c779e7fc-431f-4f50-8ba1-9dab3c1a8994-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:04 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-c779e7fc-431f-4f50-8ba1-9dab3c1a8994-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:04 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "cinder-quobyte-5300568e-06f1-4b48-92a3-655220d0ca98" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:04 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-quobyte-5300568e-06f1-4b48-92a3-655220d0ca98" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:04 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "cinder-quobyte-c779e7fc-431f-4f50-8ba1-9dab3c1a8994" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:04 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-quobyte-c779e7fc-431f-4f50-8ba1-9dab3c1a8994" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] Deleting offline snapshot c779e7fc-431f-4f50-8ba1-9dab3c1a8994 of volume 5300568e-06f1-4b48-92a3-655220d0ca98 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:10:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] snapshot_file for this snap is: volume-5300568e-06f1-4b48-92a3-655220d0ca98.c779e7fc-431f-4f50-8ba1-9dab3c1a8994 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:10:04 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[962a3961-ea03-43be-97cb-141bea369d1a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.c779e7fc-431f-4f50-8ba1-9dab3c1a8994 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:04 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3305958a-4077-489b-b204-a45274c3015e tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.728s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:04 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-3305958a-4077-489b-b204-a45274c3015e tempest-CreateVolumesFromSnapshotTest-387280520 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:10:04 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-3305958a-4077-489b-b204-a45274c3015e tempest-CreateVolumesFromSnapshotTest-387280520 None] Deleted volume successfully. Sep 04 16:10:04 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3305958a-4077-489b-b204-a45274c3015e tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-c86b6a6c-cb01-4998-8abd-66dd2a287ef0-delete_volume" released by "delete_volume" :: held 3.095s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:04 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.c779e7fc-431f-4f50-8ba1-9dab3c1a8994 Sep 04 16:10:04 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:05 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.c779e7fc-431f-4f50-8ba1-9dab3c1a8994" returned: 0 in 0.866s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:05 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5300568e-06f1-4b48-92a3-655220d0ca98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:10:05 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a424ceb-c364-466b-9175-92df0ce7e129]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:05 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98 Sep 04 16:10:05 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:06 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98" returned: 0 in 0.715s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.c779e7fc-431f-4f50-8ba1-9dab3c1a8994 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:06 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.c779e7fc-431f-4f50-8ba1-9dab3c1a8994 Sep 04 16:10:06 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:06 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87436742-9c1d-4725-9392-375fe1d871b7" returned: 0 in 6.195s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:06 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bc1453-44b9-4591-9930-dabca026c9fd]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:06 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee Sep 04 16:10:06 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:06 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.c779e7fc-431f-4f50-8ba1-9dab3c1a8994" returned: 0 in 0.484s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.c779e7fc-431f-4f50-8ba1-9dab3c1a8994 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:06 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.c779e7fc-431f-4f50-8ba1-9dab3c1a8994 Sep 04 16:10:06 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:06 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98.c779e7fc-431f-4f50-8ba1-9dab3c1a8994" returned: 0 in 0.282s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:06 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-quobyte-c779e7fc-431f-4f50-8ba1-9dab3c1a8994" released by "_delete_snapshot" :: held 2.603s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:06 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-quobyte-5300568e-06f1-4b48-92a3-655220d0ca98" released by "delete_snapshot" :: held 2.658s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] Created reservations ['9e0a5ad2-d832-4eef-a375-3443030f6a4f', 'c28519a7-3a89-4399-a3d1-4dd149bd4171', '227e1ea7-25b2-4e46-9d93-b15c8e4d9554', '998f358b-18d5-4ad2-884e-9193baf19a68'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:07 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee" returned: 0 in 0.667s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Image conversion details: src /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87436742-9c1d-4725-9392-375fe1d871b7 {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:10:07 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Converted 1024.00 MB image at 165.25 MB/s Sep 04 16:10:07 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87436742-9c1d-4725-9392-375fe1d871b7 is being set with open permissions: ugo+rw Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87436742-9c1d-4725-9392-375fe1d871b7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:07 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87436742-9c1d-4725-9392-375fe1d871b7 Sep 04 16:10:07 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Flow 'volume_create_manager' (247e663c-dde7-4778-a460-e750648c68d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea543fe-764c-448b-81b9-27e259a6628c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:07 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] Delete snapshot completed successfully. Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea543fe-764c-448b-81b9-27e259a6628c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfc8464-2881-4113-b8ec-87609c9c39bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9547ed50596f48ff9f4851852e561d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:07Z,use_quota=True,user_id='ab2d1fc04e5d4a1aa6daba488ef26668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb5b77c-5083-4b46-9150-04db84ea2990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb5b77c-5083-4b46-9150-04db84ea2990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46a7a5e-8e9f-48b1-a1a1-dd2a504983e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.image.glance [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Creating Keystone auth plugin from conf {{(pid=87513) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d591dcb4-8894-4f15-8ba9-8762674ccc01 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-c779e7fc-431f-4f50-8ba1-9dab3c1a8994-delete_snapshot" released by "delete_snapshot" :: held 3.021s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:07 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87436742-9c1d-4725-9392-375fe1d871b7" returned: 0 in 0.285s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Lock "cinder-quobyte-87436742-9c1d-4725-9392-375fe1d871b7" released by "_copy_volume_from_snapshot" :: held 8.177s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Lock "cinder-quobyte-4000e429-0b21-4990-be30-e1c7177ed73f-87436742-9c1d-4725-9392-375fe1d871b7" released by "_create_volume_from_snapshot" :: held 8.223s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.243s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf2075f-cfaf-4fb4-84da-55012f719f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87436742-9c1d-4725-9392-375fe1d871b7', 'volume_size': 1, 'snapshot_id': '4000e429-0b21-4990-be30-e1c7177ed73f'}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b286f67e-f5fc-4cdf-a512-fe15afda858f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:07 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Volume volume-87436742-9c1d-4725-9392-375fe1d871b7 (87436742-9c1d-4725-9392-375fe1d871b7): created successfully Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b286f67e-f5fc-4cdf-a512-fe15afda858f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Flow 'volume_create_manager' (cfa37f59-37c6-47e4-b700-04eaf0e99974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:07 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-9bef0000-b132-4381-83bf-03273a33f1b0 tempest-VolumeDependencyTests-1373003075 None] Created volume successfully. Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-eff9ba10-4ad9-4139-bc61-36ecef637c15 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "cinder-5300568e-06f1-4b48-92a3-655220d0ca98-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-eff9ba10-4ad9-4139-bc61-36ecef637c15 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-5300568e-06f1-4b48-92a3-655220d0ca98-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-eff9ba10-4ad9-4139-bc61-36ecef637c15 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "cinder-quobyte-5300568e-06f1-4b48-92a3-655220d0ca98" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-eff9ba10-4ad9-4139-bc61-36ecef637c15 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-quobyte-5300568e-06f1-4b48-92a3-655220d0ca98" acquired by "delete_volume" :: waited 0.021s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[2107f528-952c-47fa-8b47-da0e7319602c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-eff9ba10-4ad9-4139-bc61-36ecef637c15 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46a7a5e-8e9f-48b1-a1a1-dd2a504983e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bbfc8464-2881-4113-b8ec-87609c9c39bc', 'volume_name': 'volume-bbfc8464-2881-4113-b8ec-87609c9c39bc', 'volume_size': 1, 'image_id': 'af5d1234-3dce-4241-a278-2897635a3fbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af5d1234-3dce-4241-a278-2897635a3fbb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3575f6fa97bc6d10a99c8598e274c4ae', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9547ed50596f48ff9f4851852e561d55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9df3fb6d89a992e89166c2ecf415d04d679bd4a837df3dcb7b8af9ec8961fe6ea3d1648df428bbb6804a38ee605657b070d56311a11e6643df14d3974c9fa94a', 'id': 'af5d1234-3dce-4241-a278-2897635a3fbb', 'created_at': datetime.datetime(2026, 9, 4, 14, 10, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 10, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af5d1234-3dce-4241-a278-2897635a3fbb/file', 'properties': {}}, 'image_service': }' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a99c87-d835-4a94-b486-e7bc2986980c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a99c87-d835-4a94-b486-e7bc2986980c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88c6cda5-f449-401a-9c9a-db6033510c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:07 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Volume bbfc8464-2881-4113-b8ec-87609c9c39bc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bbfc8464-2881-4113-b8ec-87609c9c39bc', 'volume_size': 1, 'image_id': 'af5d1234-3dce-4241-a278-2897635a3fbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af5d1234-3dce-4241-a278-2897635a3fbb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3575f6fa97bc6d10a99c8598e274c4ae', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9547ed50596f48ff9f4851852e561d55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9df3fb6d89a992e89166c2ecf415d04d679bd4a837df3dcb7b8af9ec8961fe6ea3d1648df428bbb6804a38ee605657b070d56311a11e6643df14d3974c9fa94a', 'id': 'af5d1234-3dce-4241-a278-2897635a3fbb', 'created_at': datetime.datetime(2026, 9, 4, 14, 10, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 10, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af5d1234-3dce-4241-a278-2897635a3fbb/file', 'properties': {}}, 'image_service': } Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Trying to clone bbfc8464-2881-4113-b8ec-87609c9c39bc from image af5d1234-3dce-4241-a278-2897635a3fbb at location (None, [{'url': 'file:///opt/stack/data/glance/images/af5d1234-3dce-4241-a278-2897635a3fbb', 'metadata': {}}]). {{(pid=87513) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 16:10:07 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98 Sep 04 16:10:07 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 16:10:07 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Image download 0.00 MB at 0.00 MB/s Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa5e8e4-6c19-41e0-a8fd-83e89572e0dc]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:08 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD Sep 04 16:10:08 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:08 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-eff9ba10-4ad9-4139-bc61-36ecef637c15 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98" returned: 0 in 0.439s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-eff9ba10-4ad9-4139-bc61-36ecef637c15 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] Acquiring lock "cinder-4000e429-0b21-4990-be30-e1c7177ed73f-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:08 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98 Sep 04 16:10:08 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] Lock "cinder-4000e429-0b21-4990-be30-e1c7177ed73f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] Acquiring lock "cinder-quobyte-616a7018-db38-481b-9420-2187678bbbee" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] Lock "cinder-quobyte-616a7018-db38-481b-9420-2187678bbbee" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] Acquiring lock "cinder-quobyte-4000e429-0b21-4990-be30-e1c7177ed73f" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] Lock "cinder-quobyte-4000e429-0b21-4990-be30-e1c7177ed73f" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] Deleting offline snapshot 4000e429-0b21-4990-be30-e1c7177ed73f of volume 616a7018-db38-481b-9420-2187678bbbee {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] snapshot_file for this snap is: volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a261bd2b-1ccb-4edb-8b1c-4af406115a57]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:08 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:08 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f Sep 04 16:10:08 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:08 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD Sep 04 16:10:08 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:08 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-eff9ba10-4ad9-4139-bc61-36ecef637c15 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-5300568e-06f1-4b48-92a3-655220d0ca98" returned: 0 in 0.389s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-eff9ba10-4ad9-4139-bc61-36ecef637c15 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-quobyte-5300568e-06f1-4b48-92a3-655220d0ca98" released by "delete_volume" :: held 0.887s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-eff9ba10-4ad9-4139-bc61-36ecef637c15 tempest-CreateVolumesFromSnapshotTest-387280520 None] Created reservations ['bcc51caa-cb01-4ddc-907f-d690f5be1f2b', '592a7eb5-d992-4d27-bf75-a66dcd8e3057', 'cf1d63d5-12bf-4bdb-9bf5-998937712f3b', 'a73c5b0a-bd96-4267-b76e-1a3353ae8dc6'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-eff9ba10-4ad9-4139-bc61-36ecef637c15 tempest-CreateVolumesFromSnapshotTest-387280520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-eff9ba10-4ad9-4139-bc61-36ecef637c15 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-eff9ba10-4ad9-4139-bc61-36ecef637c15 tempest-CreateVolumesFromSnapshotTest-387280520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-eff9ba10-4ad9-4139-bc61-36ecef637c15 tempest-CreateVolumesFromSnapshotTest-387280520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-eff9ba10-4ad9-4139-bc61-36ecef637c15 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-eff9ba10-4ad9-4139-bc61-36ecef637c15 tempest-CreateVolumesFromSnapshotTest-387280520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:08 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:10:08 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:10:08 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Temporary image af5d1234-3dce-4241-a278-2897635a3fbb is fetched for user ab2d1fc04e5d4a1aa6daba488ef26668. {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 16:10:08 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f" returned: 0 in 0.466s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-616a7018-db38-481b-9420-2187678bbbee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb41b443-d78f-4b4a-acfe-e93952725c1c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5861ada-5910-4cbd-b1ed-be2df3c21424]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:08 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee Sep 04 16:10:08 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:09 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:09 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD Sep 04 16:10:09 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-eff9ba10-4ad9-4139-bc61-36ecef637c15 tempest-CreateVolumesFromSnapshotTest-387280520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.294s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-eff9ba10-4ad9-4139-bc61-36ecef637c15 tempest-CreateVolumesFromSnapshotTest-387280520 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:10:09 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-eff9ba10-4ad9-4139-bc61-36ecef637c15 tempest-CreateVolumesFromSnapshotTest-387280520 None] Deleted volume successfully. Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-eff9ba10-4ad9-4139-bc61-36ecef637c15 tempest-CreateVolumesFromSnapshotTest-387280520 None] Lock "cinder-5300568e-06f1-4b48-92a3-655220d0ca98-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:09 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee" returned: 0 in 0.400s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:09 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:09 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f Sep 04 16:10:09 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:09 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD Sep 04 16:10:09 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:09 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD" returned: 1 in 0.390s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfc8464-2881-4113-b8ec-87609c9c39bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9547ed50596f48ff9f4851852e561d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:07Z,use_quota=True,user_id='ab2d1fc04e5d4a1aa6daba488ef26668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Creating volume bbfc8464-2881-4113-b8ec-87609c9c39bc {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:10:09 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:09 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f" returned: 0 in 0.432s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:09 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc 1073741824 Sep 04 16:10:09 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:09 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f Sep 04 16:10:09 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:10 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee.4000e429-0b21-4990-be30-e1c7177ed73f" returned: 0 in 0.344s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:10 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] Lock "cinder-quobyte-4000e429-0b21-4990-be30-e1c7177ed73f" released by "_delete_snapshot" :: held 1.773s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:10 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] Lock "cinder-quobyte-616a7018-db38-481b-9420-2187678bbbee" released by "delete_snapshot" :: held 1.818s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:10 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] Created reservations ['ec8eaf65-6c27-4006-9c8a-74b756635cc9', 'd3ab39a9-007d-4a25-9995-b4d3b21f4e4e', '58b23610-b322-413c-a6da-0161357b6eff', 'cae690ff-decf-4276-a90f-f98f53578d47'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:10 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc 1073741824" returned: 0 in 0.531s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:10 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc Sep 04 16:10:10 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:10 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] Delete snapshot completed successfully. Sep 04 16:10:10 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-b5da6ab2-5112-4383-b2c5-f1b0e67a244b tempest-VolumeDependencyTests-1373003075 None] Lock "cinder-4000e429-0b21-4990-be30-e1c7177ed73f-delete_snapshot" released by "delete_snapshot" :: held 2.106s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:10 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-932b50a5-eff6-4181-b278-6c439b805681 tempest-VolumeDependencyTests-1373003075 None] Acquiring lock "cinder-616a7018-db38-481b-9420-2187678bbbee-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:10 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-932b50a5-eff6-4181-b278-6c439b805681 tempest-VolumeDependencyTests-1373003075 None] Lock "cinder-616a7018-db38-481b-9420-2187678bbbee-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:10 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-932b50a5-eff6-4181-b278-6c439b805681 tempest-VolumeDependencyTests-1373003075 None] Acquiring lock "cinder-quobyte-616a7018-db38-481b-9420-2187678bbbee" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:10 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-932b50a5-eff6-4181-b278-6c439b805681 tempest-VolumeDependencyTests-1373003075 None] Lock "cinder-quobyte-616a7018-db38-481b-9420-2187678bbbee" acquired by "delete_volume" :: waited 0.022s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:10 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc" returned: 0 in 0.342s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:10 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:10:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:10 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[65289940-1c9e-4332-be88-d370b5215dc5]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-932b50a5-eff6-4181-b278-6c439b805681 tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:10 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Attempting download of af5d1234-3dce-4241-a278-2897635a3fbb ((None, [{'url': 'file:///opt/stack/data/glance/images/af5d1234-3dce-4241-a278-2897635a3fbb', 'metadata': {}}])) to volume bbfc8464-2881-4113-b8ec-87609c9c39bc. {{(pid=87513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 16:10:10 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4e523b-4163-4196-b192-777d2197057d]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af5d1234-3dce-4241-a278-2897635a3fbb_x1cayxg_ {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:10 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee Sep 04 16:10:10 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:10 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af5d1234-3dce-4241-a278-2897635a3fbb_x1cayxg_ Sep 04 16:10:10 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:11 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-932b50a5-eff6-4181-b278-6c439b805681 tempest-VolumeDependencyTests-1373003075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee" returned: 0 in 0.422s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-932b50a5-eff6-4181-b278-6c439b805681 tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:11 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee Sep 04 16:10:11 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:11 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af5d1234-3dce-4241-a278-2897635a3fbb_x1cayxg_" returned: 0 in 0.351s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af5d1234-3dce-4241-a278-2897635a3fbb_x1cayxg_ {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:11 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af5d1234-3dce-4241-a278-2897635a3fbb_x1cayxg_ Sep 04 16:10:11 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:11 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-932b50a5-eff6-4181-b278-6c439b805681 tempest-VolumeDependencyTests-1373003075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-616a7018-db38-481b-9420-2187678bbbee" returned: 0 in 0.293s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-932b50a5-eff6-4181-b278-6c439b805681 tempest-VolumeDependencyTests-1373003075 None] Lock "cinder-quobyte-616a7018-db38-481b-9420-2187678bbbee" released by "delete_volume" :: held 0.807s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-932b50a5-eff6-4181-b278-6c439b805681 tempest-VolumeDependencyTests-1373003075 None] Created reservations ['331cba6f-817b-42b0-b70e-2ed81451d3de', 'e926a11b-5edd-4c8c-92ae-7d41ec81bfb4', '81ab274f-4ea8-4f14-bb90-eafe065c6767', 'c18f188a-62c5-4701-9344-5a2f2443a9de'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:11 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af5d1234-3dce-4241-a278-2897635a3fbb_x1cayxg_" returned: 1 in 0.387s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af5d1234-3dce-4241-a278-2897635a3fbb_x1cayxg_' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2cb5d7-07f2-4477-bc43-4b2988696c9a]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-932b50a5-eff6-4181-b278-6c439b805681 tempest-VolumeDependencyTests-1373003075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-932b50a5-eff6-4181-b278-6c439b805681 tempest-VolumeDependencyTests-1373003075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-932b50a5-eff6-4181-b278-6c439b805681 tempest-VolumeDependencyTests-1373003075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-932b50a5-eff6-4181-b278-6c439b805681 tempest-VolumeDependencyTests-1373003075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-932b50a5-eff6-4181-b278-6c439b805681 tempest-VolumeDependencyTests-1373003075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-932b50a5-eff6-4181-b278-6c439b805681 tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:11 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:10:11 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:11 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD Sep 04 16:10:11 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5369c89b-8d14-4ad9-bea8-e05137bd964c tempest-VolumeDependencyTests-1373003075 None] Acquiring lock "cinder-87436742-9c1d-4725-9392-375fe1d871b7-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5369c89b-8d14-4ad9-bea8-e05137bd964c tempest-VolumeDependencyTests-1373003075 None] Lock "cinder-87436742-9c1d-4725-9392-375fe1d871b7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5369c89b-8d14-4ad9-bea8-e05137bd964c tempest-VolumeDependencyTests-1373003075 None] Acquiring lock "cinder-quobyte-87436742-9c1d-4725-9392-375fe1d871b7" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:11 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5369c89b-8d14-4ad9-bea8-e05137bd964c tempest-VolumeDependencyTests-1373003075 None] Lock "cinder-quobyte-87436742-9c1d-4725-9392-375fe1d871b7" acquired by "delete_volume" :: waited 0.021s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-932b50a5-eff6-4181-b278-6c439b805681 tempest-VolumeDependencyTests-1373003075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.338s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-932b50a5-eff6-4181-b278-6c439b805681 tempest-VolumeDependencyTests-1373003075 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:10:11 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-932b50a5-eff6-4181-b278-6c439b805681 tempest-VolumeDependencyTests-1373003075 None] Deleted volume successfully. Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc78d889-f083-4fed-9b1f-8e661d1f2fb3]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5369c89b-8d14-4ad9-bea8-e05137bd964c tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87436742-9c1d-4725-9392-375fe1d871b7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-932b50a5-eff6-4181-b278-6c439b805681 tempest-VolumeDependencyTests-1373003075 None] Lock "cinder-616a7018-db38-481b-9420-2187678bbbee-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:12 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD" returned: 0 in 0.494s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:12 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87436742-9c1d-4725-9392-375fe1d871b7 Sep 04 16:10:12 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:12 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD Sep 04 16:10:12 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:12 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5369c89b-8d14-4ad9-bea8-e05137bd964c tempest-VolumeDependencyTests-1373003075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87436742-9c1d-4725-9392-375fe1d871b7" returned: 0 in 0.541s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5369c89b-8d14-4ad9-bea8-e05137bd964c tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87436742-9c1d-4725-9392-375fe1d871b7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:12 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD" returned: 1 in 0.509s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:10:12 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] af5d1234-3dce-4241-a278-2897635a3fbb was raw, converting to raw {{(pid=87513) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 16:10:12 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87436742-9c1d-4725-9392-375fe1d871b7 Sep 04 16:10:12 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:12 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc Sep 04 16:10:12 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:12 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5369c89b-8d14-4ad9-bea8-e05137bd964c tempest-VolumeDependencyTests-1373003075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87436742-9c1d-4725-9392-375fe1d871b7" returned: 0 in 0.271s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:12 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5369c89b-8d14-4ad9-bea8-e05137bd964c tempest-VolumeDependencyTests-1373003075 None] Lock "cinder-quobyte-87436742-9c1d-4725-9392-375fe1d871b7" released by "delete_volume" :: held 0.887s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:12 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-5369c89b-8d14-4ad9-bea8-e05137bd964c tempest-VolumeDependencyTests-1373003075 None] Created reservations ['d380e626-8bdb-40a2-8508-24491ac17f02', '4043cec2-a4c2-4245-8117-60d7a9e73c37', 'b8dc3b8c-7b99-4535-b83f-0f651cf67c33', '1ba2ec3f-d995-4e9b-95e1-347c50242332'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5369c89b-8d14-4ad9-bea8-e05137bd964c tempest-VolumeDependencyTests-1373003075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5369c89b-8d14-4ad9-bea8-e05137bd964c tempest-VolumeDependencyTests-1373003075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5369c89b-8d14-4ad9-bea8-e05137bd964c tempest-VolumeDependencyTests-1373003075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5369c89b-8d14-4ad9-bea8-e05137bd964c tempest-VolumeDependencyTests-1373003075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5369c89b-8d14-4ad9-bea8-e05137bd964c tempest-VolumeDependencyTests-1373003075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5369c89b-8d14-4ad9-bea8-e05137bd964c tempest-VolumeDependencyTests-1373003075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:12 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:10:12 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:13 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc" returned: 0 in 0.472s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_af5d1234-3dce-4241-a278-2897635a3fbb_x5id_qsfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:10:13 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:13 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc 1G Sep 04 16:10:13 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:13 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5369c89b-8d14-4ad9-bea8-e05137bd964c tempest-VolumeDependencyTests-1373003075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.313s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-5369c89b-8d14-4ad9-bea8-e05137bd964c tempest-VolumeDependencyTests-1373003075 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:10:13 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-5369c89b-8d14-4ad9-bea8-e05137bd964c tempest-VolumeDependencyTests-1373003075 None] Deleted volume successfully. Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5369c89b-8d14-4ad9-bea8-e05137bd964c tempest-VolumeDependencyTests-1373003075 None] Lock "cinder-87436742-9c1d-4725-9392-375fe1d871b7-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:13 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc 1G" returned: 0 in 0.359s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7999d4-2809-4840-b037-bf0b867bb310]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:13 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc Sep 04 16:10:13 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Flow 'volume_create_manager' (55239049-5078-4265-a65b-ba73473b9244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cdfead9-ff17-4bed-b389-a4c2e87aab74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cdfead9-ff17-4bed-b389-a4c2e87aab74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1553045949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07a876d-423c-4bce-936f-8ddb64d9f6fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d593cb3eb6da46f69921e656655b8818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:14Z,use_quota=True,user_id='220d80071e994704b5583b7626d65316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa8581e-e7bb-4708-85d7-027737c62581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa8581e-e7bb-4708-85d7-027737c62581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd2015c-c826-4ef9-a20c-339ad76ae709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd2015c-c826-4ef9-a20c-339ad76ae709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b07a876d-423c-4bce-936f-8ddb64d9f6fc', 'volume_name': 'volume-b07a876d-423c-4bce-936f-8ddb64d9f6fc', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa72d03a-8275-4378-8860-302cc10ccb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa72d03a-8275-4378-8860-302cc10ccb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c528629-a77f-430b-b280-98758de88b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:13 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Volume b07a876d-423c-4bce-936f-8ddb64d9f6fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b07a876d-423c-4bce-936f-8ddb64d9f6fc', 'volume_size': 1} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1553045949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07a876d-423c-4bce-936f-8ddb64d9f6fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d593cb3eb6da46f69921e656655b8818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:14Z,use_quota=True,user_id='220d80071e994704b5583b7626d65316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Creating volume b07a876d-423c-4bce-936f-8ddb64d9f6fc {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:10:13 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b07a876d-423c-4bce-936f-8ddb64d9f6fc 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:13 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc" returned: 0 in 0.409s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:13 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b07a876d-423c-4bce-936f-8ddb64d9f6fc 1073741824 Sep 04 16:10:13 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:13 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc Sep 04 16:10:13 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:14 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc" returned: 1 in 0.454s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Downloaded image af5d1234-3dce-4241-a278-2897635a3fbb ((None, [{'url': 'file:///opt/stack/data/glance/images/af5d1234-3dce-4241-a278-2897635a3fbb', 'metadata': {}}])) to volume bbfc8464-2881-4113-b8ec-87609c9c39bc successfully. {{(pid=87513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Temporary image af5d1234-3dce-4241-a278-2897635a3fbb for user ab2d1fc04e5d4a1aa6daba488ef26668 is deleted. {{(pid=87513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG cinder.volume.volume_utils [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Marking volume bbfc8464-2881-4113-b8ec-87609c9c39bc as bootable. {{(pid=87513) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Copying metadata from image af5d1234-3dce-4241-a278-2897635a3fbb to bbfc8464-2881-4113-b8ec-87609c9c39bc. {{(pid=87513) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Creating volume glance metadata for volume bbfc8464-2881-4113-b8ec-87609c9c39bc backed by image af5d1234-3dce-4241-a278-2897635a3fbb with: {'image_id': 'af5d1234-3dce-4241-a278-2897635a3fbb', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3575f6fa97bc6d10a99c8598e274c4ae', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87513) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 16:10:14 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b07a876d-423c-4bce-936f-8ddb64d9f6fc 1073741824" returned: 0 in 0.549s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88c6cda5-f449-401a-9c9a-db6033510c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbfc8464-2881-4113-b8ec-87609c9c39bc', 'volume_size': 1, 'image_id': 'af5d1234-3dce-4241-a278-2897635a3fbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af5d1234-3dce-4241-a278-2897635a3fbb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3575f6fa97bc6d10a99c8598e274c4ae', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9547ed50596f48ff9f4851852e561d55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9df3fb6d89a992e89166c2ecf415d04d679bd4a837df3dcb7b8af9ec8961fe6ea3d1648df428bbb6804a38ee605657b070d56311a11e6643df14d3974c9fa94a', 'id': 'af5d1234-3dce-4241-a278-2897635a3fbb', 'created_at': datetime.datetime(2026, 9, 4, 14, 10, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 10, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af5d1234-3dce-4241-a278-2897635a3fbb/file', 'properties': {}}, 'image_service': }' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe3e9ff-621f-4abd-80cc-c74902bf3231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b07a876d-423c-4bce-936f-8ddb64d9f6fc {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:14 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Volume volume-bbfc8464-2881-4113-b8ec-87609c9c39bc (bbfc8464-2881-4113-b8ec-87609c9c39bc): created successfully Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe3e9ff-621f-4abd-80cc-c74902bf3231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:14 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b07a876d-423c-4bce-936f-8ddb64d9f6fc Sep 04 16:10:14 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Flow 'volume_create_manager' (247e663c-dde7-4778-a460-e750648c68d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:14 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-2c6dbe94-2c88-481a-a09d-621acc92613a tempest-VolumeImageDependencyTests-1492618725 None] Created volume successfully. Sep 04 16:10:14 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b07a876d-423c-4bce-936f-8ddb64d9f6fc" returned: 0 in 0.316s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c528629-a77f-430b-b280-98758de88b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b07a876d-423c-4bce-936f-8ddb64d9f6fc', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6185ab7a-1f23-4e1b-b9c9-5d6dba82ac85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:14 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Volume volume-b07a876d-423c-4bce-936f-8ddb64d9f6fc (b07a876d-423c-4bce-936f-8ddb64d9f6fc): created successfully Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6185ab7a-1f23-4e1b-b9c9-5d6dba82ac85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Flow 'volume_create_manager' (55239049-5078-4265-a65b-ba73473b9244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:14 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-3f2198f4-4cb4-41fc-abee-804330734c62 tempest-ProjectReaderTests-492338931 None] Created volume successfully. Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] Acquiring lock "cinder-bbfc8464-2881-4113-b8ec-87609c9c39bc-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] Lock "cinder-bbfc8464-2881-4113-b8ec-87609c9c39bc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] Acquiring lock "cinder-quobyte-bbfc8464-2881-4113-b8ec-87609c9c39bc" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] Lock "cinder-quobyte-bbfc8464-2881-4113-b8ec-87609c9c39bc" acquired by "delete_volume" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:15 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82fb6c5-b13e-454f-af88-5287bfab6174]: (4, 'raw') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:15 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc Sep 04 16:10:15 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:15 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc" returned: 0 in 0.397s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:15 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc Sep 04 16:10:15 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:15 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:15 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc Sep 04 16:10:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc" returned: 1 in 0.390s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc' failed. Not Retrying. {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:10:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:15 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:16 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bbfc8464-2881-4113-b8ec-87609c9c39bc" returned: 0 in 0.404s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] Lock "cinder-quobyte-bbfc8464-2881-4113-b8ec-87609c9c39bc" released by "delete_volume" :: held 1.276s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2bf30e4f-194d-4aad-bf4e-9c24650f3809 tempest-ProjectReaderTests-492338931 None] Acquiring lock "cinder-b07a876d-423c-4bce-936f-8ddb64d9f6fc-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2bf30e4f-194d-4aad-bf4e-9c24650f3809 tempest-ProjectReaderTests-492338931 None] Lock "cinder-b07a876d-423c-4bce-936f-8ddb64d9f6fc-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2bf30e4f-194d-4aad-bf4e-9c24650f3809 tempest-ProjectReaderTests-492338931 None] Acquiring lock "cinder-quobyte-b07a876d-423c-4bce-936f-8ddb64d9f6fc" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:16 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] Created reservations ['743047f3-54d5-4360-a33c-b32c45bd44b4', '6a60979b-afc0-4e26-8409-59afcfbc8d49', '8f5b9fd5-cb3c-420a-a532-ad585c4f1a82', '039c3795-a1c4-446a-9280-e6ce53afeebf'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2bf30e4f-194d-4aad-bf4e-9c24650f3809 tempest-ProjectReaderTests-492338931 None] Lock "cinder-quobyte-b07a876d-423c-4bce-936f-8ddb64d9f6fc" acquired by "delete_volume" :: waited 0.038s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:16 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9842e39b-910f-4cfc-915d-ddc3da0f851d]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2bf30e4f-194d-4aad-bf4e-9c24650f3809 tempest-ProjectReaderTests-492338931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b07a876d-423c-4bce-936f-8ddb64d9f6fc {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:16 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:10:16 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:16 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b07a876d-423c-4bce-936f-8ddb64d9f6fc Sep 04 16:10:16 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:16 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2bf30e4f-194d-4aad-bf4e-9c24650f3809 tempest-ProjectReaderTests-492338931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b07a876d-423c-4bce-936f-8ddb64d9f6fc" returned: 0 in 0.475s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2bf30e4f-194d-4aad-bf4e-9c24650f3809 tempest-ProjectReaderTests-492338931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b07a876d-423c-4bce-936f-8ddb64d9f6fc {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:16 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.387s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:16 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:10:17 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b07a876d-423c-4bce-936f-8ddb64d9f6fc Sep 04 16:10:17 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:17 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] Deleted volume successfully. Sep 04 16:10:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-27176ace-c5b4-40c1-a22b-435850a822fd tempest-VolumeImageDependencyTests-1492618725 None] Lock "cinder-bbfc8464-2881-4113-b8ec-87609c9c39bc-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:17 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2bf30e4f-194d-4aad-bf4e-9c24650f3809 tempest-ProjectReaderTests-492338931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b07a876d-423c-4bce-936f-8ddb64d9f6fc" returned: 0 in 0.295s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2bf30e4f-194d-4aad-bf4e-9c24650f3809 tempest-ProjectReaderTests-492338931 None] Lock "cinder-quobyte-b07a876d-423c-4bce-936f-8ddb64d9f6fc" released by "delete_volume" :: held 0.835s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:17 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-2bf30e4f-194d-4aad-bf4e-9c24650f3809 tempest-ProjectReaderTests-492338931 None] Created reservations ['af139d3e-d04c-4553-ada4-c5b0e43a1f42', 'a1489544-06a4-481a-9dd5-3e5df5e66860', 'bb566493-05f5-44fd-b54f-759dc486b520', '892a233f-e6c9-46b7-bc60-982c34323923'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2bf30e4f-194d-4aad-bf4e-9c24650f3809 tempest-ProjectReaderTests-492338931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2bf30e4f-194d-4aad-bf4e-9c24650f3809 tempest-ProjectReaderTests-492338931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:17 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2bf30e4f-194d-4aad-bf4e-9c24650f3809 tempest-ProjectReaderTests-492338931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:17 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2bf30e4f-194d-4aad-bf4e-9c24650f3809 tempest-ProjectReaderTests-492338931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2bf30e4f-194d-4aad-bf4e-9c24650f3809 tempest-ProjectReaderTests-492338931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2bf30e4f-194d-4aad-bf4e-9c24650f3809 tempest-ProjectReaderTests-492338931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:17 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:10:17 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:17 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2bf30e4f-194d-4aad-bf4e-9c24650f3809 tempest-ProjectReaderTests-492338931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.263s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:17 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-2bf30e4f-194d-4aad-bf4e-9c24650f3809 tempest-ProjectReaderTests-492338931 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:10:17 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-2bf30e4f-194d-4aad-bf4e-9c24650f3809 tempest-ProjectReaderTests-492338931 None] Deleted volume successfully. Sep 04 16:10:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2bf30e4f-194d-4aad-bf4e-9c24650f3809 tempest-ProjectReaderTests-492338931 None] Lock "cinder-b07a876d-423c-4bce-936f-8ddb64d9f6fc-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:17 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed0890fc-3985-4c2d-9c26-b3113c9dd72a tempest-ProjectAdminTests-1438011332 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7594451904297, 'free_capacity_gb': 1773.7594451904297, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87513) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Flow 'volume_create_manager' (13233d38-f98a-4b0c-a3f0-e08990ea1c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c811840-426d-490b-8d00-ad602fff6ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c811840-426d-490b-8d00-ad602fff6ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-148500860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22122bfe-9ac7-4f3b-a82f-d3c0e2541248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d593cb3eb6da46f69921e656655b8818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:18Z,use_quota=True,user_id='220d80071e994704b5583b7626d65316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44682e2f-aeda-4352-86ea-424ce2064d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44682e2f-aeda-4352-86ea-424ce2064d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92331941-fe04-4deb-a434-78ba87cb6afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92331941-fe04-4deb-a434-78ba87cb6afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22122bfe-9ac7-4f3b-a82f-d3c0e2541248', 'volume_name': 'volume-22122bfe-9ac7-4f3b-a82f-d3c0e2541248', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0ce8e6-acc0-42b9-9b1e-08303a7a294b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0ce8e6-acc0-42b9-9b1e-08303a7a294b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c063b2-e2dd-4a61-8807-39d7ecebe4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:18 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Volume 22122bfe-9ac7-4f3b-a82f-d3c0e2541248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22122bfe-9ac7-4f3b-a82f-d3c0e2541248', 'volume_size': 1} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-148500860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22122bfe-9ac7-4f3b-a82f-d3c0e2541248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d593cb3eb6da46f69921e656655b8818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:18Z,use_quota=True,user_id='220d80071e994704b5583b7626d65316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Creating volume 22122bfe-9ac7-4f3b-a82f-d3c0e2541248 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:10:18 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-22122bfe-9ac7-4f3b-a82f-d3c0e2541248 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:18 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-22122bfe-9ac7-4f3b-a82f-d3c0e2541248 1073741824 Sep 04 16:10:18 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:18 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-22122bfe-9ac7-4f3b-a82f-d3c0e2541248 1073741824" returned: 0 in 0.492s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-22122bfe-9ac7-4f3b-a82f-d3c0e2541248 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:18 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-22122bfe-9ac7-4f3b-a82f-d3c0e2541248 Sep 04 16:10:18 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:19 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-22122bfe-9ac7-4f3b-a82f-d3c0e2541248" returned: 0 in 0.287s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:10:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c063b2-e2dd-4a61-8807-39d7ecebe4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22122bfe-9ac7-4f3b-a82f-d3c0e2541248', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e728bf5c-778a-4011-94ac-41851daee11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:19 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Volume volume-22122bfe-9ac7-4f3b-a82f-d3c0e2541248 (22122bfe-9ac7-4f3b-a82f-d3c0e2541248): created successfully Sep 04 16:10:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e728bf5c-778a-4011-94ac-41851daee11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Flow 'volume_create_manager' (13233d38-f98a-4b0c-a3f0-e08990ea1c89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:19 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-603b5dc0-dc25-40e9-88b7-e58e5dac3613 tempest-ProjectReaderTests-492338931 None] Created volume successfully. Sep 04 16:10:20 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2e0688b8-e26b-42ae-a5fc-b2020aedd0dc tempest-ProjectReaderTests-492338931 None] Acquiring lock "cinder-22122bfe-9ac7-4f3b-a82f-d3c0e2541248-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:20 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2e0688b8-e26b-42ae-a5fc-b2020aedd0dc tempest-ProjectReaderTests-492338931 None] Lock "cinder-22122bfe-9ac7-4f3b-a82f-d3c0e2541248-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:20 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2e0688b8-e26b-42ae-a5fc-b2020aedd0dc tempest-ProjectReaderTests-492338931 None] Acquiring lock "cinder-quobyte-22122bfe-9ac7-4f3b-a82f-d3c0e2541248" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:20 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2e0688b8-e26b-42ae-a5fc-b2020aedd0dc tempest-ProjectReaderTests-492338931 None] Lock "cinder-quobyte-22122bfe-9ac7-4f3b-a82f-d3c0e2541248" acquired by "delete_volume" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:20 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6021d0-50ba-4288-9eb6-0190212dff54]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2e0688b8-e26b-42ae-a5fc-b2020aedd0dc tempest-ProjectReaderTests-492338931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-22122bfe-9ac7-4f3b-a82f-d3c0e2541248 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:20 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-22122bfe-9ac7-4f3b-a82f-d3c0e2541248 Sep 04 16:10:20 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:20 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2e0688b8-e26b-42ae-a5fc-b2020aedd0dc tempest-ProjectReaderTests-492338931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-22122bfe-9ac7-4f3b-a82f-d3c0e2541248" returned: 0 in 0.453s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2e0688b8-e26b-42ae-a5fc-b2020aedd0dc tempest-ProjectReaderTests-492338931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-22122bfe-9ac7-4f3b-a82f-d3c0e2541248 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:21 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-22122bfe-9ac7-4f3b-a82f-d3c0e2541248 Sep 04 16:10:21 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:21 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2e0688b8-e26b-42ae-a5fc-b2020aedd0dc tempest-ProjectReaderTests-492338931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-22122bfe-9ac7-4f3b-a82f-d3c0e2541248" returned: 0 in 0.321s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:21 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2e0688b8-e26b-42ae-a5fc-b2020aedd0dc tempest-ProjectReaderTests-492338931 None] Lock "cinder-quobyte-22122bfe-9ac7-4f3b-a82f-d3c0e2541248" released by "delete_volume" :: held 0.824s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:21 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-2e0688b8-e26b-42ae-a5fc-b2020aedd0dc tempest-ProjectReaderTests-492338931 None] Created reservations ['37aeab55-37bc-469a-8750-4e50b87ac351', 'c4e4a3d2-9f02-47e7-9613-d9314b485689', 'aff7a656-90d3-49f7-b7f0-bd7672ab65f0', '177a47a6-3c53-4ad4-af6b-70c98b606c3d'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2e0688b8-e26b-42ae-a5fc-b2020aedd0dc tempest-ProjectReaderTests-492338931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2e0688b8-e26b-42ae-a5fc-b2020aedd0dc tempest-ProjectReaderTests-492338931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:21 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2e0688b8-e26b-42ae-a5fc-b2020aedd0dc tempest-ProjectReaderTests-492338931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:21 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2e0688b8-e26b-42ae-a5fc-b2020aedd0dc tempest-ProjectReaderTests-492338931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2e0688b8-e26b-42ae-a5fc-b2020aedd0dc tempest-ProjectReaderTests-492338931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2e0688b8-e26b-42ae-a5fc-b2020aedd0dc tempest-ProjectReaderTests-492338931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:21 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:10:21 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:21 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:21 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2e0688b8-e26b-42ae-a5fc-b2020aedd0dc tempest-ProjectReaderTests-492338931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.366s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:21 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-2e0688b8-e26b-42ae-a5fc-b2020aedd0dc tempest-ProjectReaderTests-492338931 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:10:21 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-2e0688b8-e26b-42ae-a5fc-b2020aedd0dc tempest-ProjectReaderTests-492338931 None] Deleted volume successfully. Sep 04 16:10:21 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2e0688b8-e26b-42ae-a5fc-b2020aedd0dc tempest-ProjectReaderTests-492338931 None] Lock "cinder-22122bfe-9ac7-4f3b-a82f-d3c0e2541248-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Flow 'volume_create_manager' (41779981-e14f-46a7-b03b-f1f12c160c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0f52e7-916f-4e17-8799-1681aff51553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0f52e7-916f-4e17-8799-1681aff51553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47cb3e0-c062-4747-8997-cca82ea79cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c453e7d3a44d4f9890990bc8f3dc3f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:22Z,use_quota=True,user_id='3b53ca4bc5c14508bfa4e0f206d8c6cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6849c3-49a4-456b-8e2e-8033fdd3b0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6849c3-49a4-456b-8e2e-8033fdd3b0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e52790-a89c-49ac-ba61-a482c2b2a716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e52790-a89c-49ac-ba61-a482c2b2a716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd47cb3e0-c062-4747-8997-cca82ea79cad', 'volume_name': 'volume-d47cb3e0-c062-4747-8997-cca82ea79cad', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8957287-5769-44e2-921c-2325ddf1e504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8957287-5769-44e2-921c-2325ddf1e504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451d6e8d-0ed5-4f86-8f47-95c394c7cf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:22 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Volume d47cb3e0-c062-4747-8997-cca82ea79cad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d47cb3e0-c062-4747-8997-cca82ea79cad', 'volume_size': 1} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47cb3e0-c062-4747-8997-cca82ea79cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c453e7d3a44d4f9890990bc8f3dc3f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:22Z,use_quota=True,user_id='3b53ca4bc5c14508bfa4e0f206d8c6cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Creating volume d47cb3e0-c062-4747-8997-cca82ea79cad {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:10:22 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d47cb3e0-c062-4747-8997-cca82ea79cad 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:22 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d47cb3e0-c062-4747-8997-cca82ea79cad 1073741824 Sep 04 16:10:22 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Flow 'volume_create_manager' (76ad4adf-390c-4735-8495-45708ffc12ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb72a405-7cc8-4da8-bde2-07e2bbe20659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb72a405-7cc8-4da8-bde2-07e2bbe20659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1584476679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d593cb3eb6da46f69921e656655b8818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:23Z,use_quota=True,user_id='220d80071e994704b5583b7626d65316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce5c135-dd2f-4afa-a565-68b2219e4aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce5c135-dd2f-4afa-a565-68b2219e4aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297da977-31c6-4db7-887a-ac3a226dffc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297da977-31c6-4db7-887a-ac3a226dffc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa', 'volume_name': 'volume-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4735e193-a736-4144-b176-cf6660b09fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4735e193-a736-4144-b176-cf6660b09fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec20068-c76f-4ad5-859a-3d6ace14cc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:22 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Volume 99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa', 'volume_size': 1} Sep 04 16:10:22 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:23 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d47cb3e0-c062-4747-8997-cca82ea79cad 1073741824" returned: 0 in 0.535s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d47cb3e0-c062-4747-8997-cca82ea79cad {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:23 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d47cb3e0-c062-4747-8997-cca82ea79cad Sep 04 16:10:23 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:23 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d47cb3e0-c062-4747-8997-cca82ea79cad" returned: 0 in 0.244s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:10:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.354s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1584476679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d593cb3eb6da46f69921e656655b8818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:23Z,use_quota=True,user_id='220d80071e994704b5583b7626d65316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:10:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Creating volume 99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:10:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:23 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:10:23 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:10:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451d6e8d-0ed5-4f86-8f47-95c394c7cf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d47cb3e0-c062-4747-8997-cca82ea79cad', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:23 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa 1073741824 Sep 04 16:10:23 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee1ebe7-c0b5-4d16-a009-e0cb4057d4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:23 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Volume volume-d47cb3e0-c062-4747-8997-cca82ea79cad (d47cb3e0-c062-4747-8997-cca82ea79cad): created successfully Sep 04 16:10:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee1ebe7-c0b5-4d16-a009-e0cb4057d4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:23 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Flow 'volume_create_manager' (41779981-e14f-46a7-b03b-f1f12c160c49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:23 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-0d494004-1e3f-4f56-a671-9c471d035d05 tempest-CinderUnicodeTest-1133348320 None] Created volume successfully. Sep 04 16:10:23 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa 1073741824" returned: 0 in 0.432s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:23 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:23 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa Sep 04 16:10:23 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:24 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa" returned: 0 in 0.288s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:24 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:10:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec20068-c76f-4ad5-859a-3d6ace14cc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2ab747-d21e-43c0-a668-69d55fb0980c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:24 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Volume volume-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa (99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa): created successfully Sep 04 16:10:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2ab747-d21e-43c0-a668-69d55fb0980c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:24 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Flow 'volume_create_manager' (76ad4adf-390c-4735-8495-45708ffc12ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:24 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-6781bca1-2c97-4fee-817f-751ab08ed00b tempest-ProjectReaderTests-492338931 None] Created volume successfully. Sep 04 16:10:24 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1b34d615-f091-4ae3-bc10-e1145ae07cb3 tempest-ProjectReaderTests-492338931 None] Acquiring lock "cinder-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:24 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1b34d615-f091-4ae3-bc10-e1145ae07cb3 tempest-ProjectReaderTests-492338931 None] Lock "cinder-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:24 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1b34d615-f091-4ae3-bc10-e1145ae07cb3 tempest-ProjectReaderTests-492338931 None] Acquiring lock "cinder-quobyte-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1b34d615-f091-4ae3-bc10-e1145ae07cb3 tempest-ProjectReaderTests-492338931 None] Lock "cinder-quobyte-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa" acquired by "delete_volume" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afc7010-46cf-48ea-af39-28f3a85ca9f0]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1b34d615-f091-4ae3-bc10-e1145ae07cb3 tempest-ProjectReaderTests-492338931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Flow 'volume_create_manager' (44fdd2e6-01b8-4551-912e-77a34a59820e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d69c6840-7001-4f33-b346-fb2542a6666e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:25 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa Sep 04 16:10:25 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d69c6840-7001-4f33-b346-fb2542a6666e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1606301237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=226a464f-8172-49f4-8f4e-b676b2c0b747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c453e7d3a44d4f9890990bc8f3dc3f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:25Z,use_quota=True,user_id='3b53ca4bc5c14508bfa4e0f206d8c6cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757032fa-5d09-451b-9477-cc7ee1e2a216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757032fa-5d09-451b-9477-cc7ee1e2a216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6d4ae55-f3d5-47f7-832f-d758efab5c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6d4ae55-f3d5-47f7-832f-d758efab5c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '226a464f-8172-49f4-8f4e-b676b2c0b747', 'volume_name': 'volume-226a464f-8172-49f4-8f4e-b676b2c0b747', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfcccc94-5fd1-41a2-86f2-9a280278a13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfcccc94-5fd1-41a2-86f2-9a280278a13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (accc124b-afb0-456d-8fca-882d56141810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:25 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Volume 226a464f-8172-49f4-8f4e-b676b2c0b747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-226a464f-8172-49f4-8f4e-b676b2c0b747', 'volume_size': 1} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1606301237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=226a464f-8172-49f4-8f4e-b676b2c0b747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c453e7d3a44d4f9890990bc8f3dc3f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:25Z,use_quota=True,user_id='3b53ca4bc5c14508bfa4e0f206d8c6cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Creating volume 226a464f-8172-49f4-8f4e-b676b2c0b747 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:10:25 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:25 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747 1073741824 Sep 04 16:10:25 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:25 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1b34d615-f091-4ae3-bc10-e1145ae07cb3 tempest-ProjectReaderTests-492338931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa" returned: 0 in 0.447s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1b34d615-f091-4ae3-bc10-e1145ae07cb3 tempest-ProjectReaderTests-492338931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:25 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa Sep 04 16:10:25 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:25 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747 1073741824" returned: 0 in 0.508s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:25 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1b34d615-f091-4ae3-bc10-e1145ae07cb3 tempest-ProjectReaderTests-492338931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa" returned: 0 in 0.307s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:25 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747 Sep 04 16:10:25 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1b34d615-f091-4ae3-bc10-e1145ae07cb3 tempest-ProjectReaderTests-492338931 None] Lock "cinder-quobyte-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa" released by "delete_volume" :: held 0.818s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:25 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-1b34d615-f091-4ae3-bc10-e1145ae07cb3 tempest-ProjectReaderTests-492338931 None] Created reservations ['0a2d0de9-ba5f-4da6-9a36-cdc331801d55', '65811fc4-b333-41a0-9fd7-4ab30b6ecf67', 'aeb5f92e-d971-46c1-a399-2464c341c3c1', 'd6d8ee0a-f03d-4d64-95ea-7a969bed9837'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1b34d615-f091-4ae3-bc10-e1145ae07cb3 tempest-ProjectReaderTests-492338931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1b34d615-f091-4ae3-bc10-e1145ae07cb3 tempest-ProjectReaderTests-492338931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1b34d615-f091-4ae3-bc10-e1145ae07cb3 tempest-ProjectReaderTests-492338931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1b34d615-f091-4ae3-bc10-e1145ae07cb3 tempest-ProjectReaderTests-492338931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1b34d615-f091-4ae3-bc10-e1145ae07cb3 tempest-ProjectReaderTests-492338931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1b34d615-f091-4ae3-bc10-e1145ae07cb3 tempest-ProjectReaderTests-492338931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:26 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:10:26 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:26 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747" returned: 0 in 0.368s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (accc124b-afb0-456d-8fca-882d56141810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-226a464f-8172-49f4-8f4e-b676b2c0b747', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d4be03-db82-45ff-bb62-4f9f5d49902b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:26 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Volume volume-226a464f-8172-49f4-8f4e-b676b2c0b747 (226a464f-8172-49f4-8f4e-b676b2c0b747): created successfully Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d4be03-db82-45ff-bb62-4f9f5d49902b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Flow 'volume_create_manager' (44fdd2e6-01b8-4551-912e-77a34a59820e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:26 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-f5329471-cac8-4b08-b8e6-3b1f89a99570 tempest-CinderUnicodeTest-1133348320 None] Created volume successfully. Sep 04 16:10:26 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1b34d615-f091-4ae3-bc10-e1145ae07cb3 tempest-ProjectReaderTests-492338931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.386s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-1b34d615-f091-4ae3-bc10-e1145ae07cb3 tempest-ProjectReaderTests-492338931 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:10:26 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-1b34d615-f091-4ae3-bc10-e1145ae07cb3 tempest-ProjectReaderTests-492338931 None] Deleted volume successfully. Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1b34d615-f091-4ae3-bc10-e1145ae07cb3 tempest-ProjectReaderTests-492338931 None] Lock "cinder-99ccf385-5fc7-4ef7-aa72-6bc5ab4247aa-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Flow 'volume_create_manager' (115fe504-ce80-4e96-89f2-7580808d4437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39c0990-1bee-4385-97a7-e35d46a26a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39c0990-1bee-4385-97a7-e35d46a26a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-907410397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a57a7042-c953-4035-ac15-485dd758450f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d593cb3eb6da46f69921e656655b8818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:27Z,use_quota=True,user_id='220d80071e994704b5583b7626d65316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d708c1fe-9541-4bf3-b1bf-a7e0013e7f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d708c1fe-9541-4bf3-b1bf-a7e0013e7f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28be133-80e2-4d63-b45b-46c65cb5f96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28be133-80e2-4d63-b45b-46c65cb5f96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a57a7042-c953-4035-ac15-485dd758450f', 'volume_name': 'volume-a57a7042-c953-4035-ac15-485dd758450f', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a387b9ee-226a-4601-ab9a-da909fd48077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a387b9ee-226a-4601-ab9a-da909fd48077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc029c3a-2d60-4baa-b441-3d59f8e26dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:26 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Volume a57a7042-c953-4035-ac15-485dd758450f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a57a7042-c953-4035-ac15-485dd758450f', 'volume_size': 1} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-907410397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a57a7042-c953-4035-ac15-485dd758450f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d593cb3eb6da46f69921e656655b8818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:27Z,use_quota=True,user_id='220d80071e994704b5583b7626d65316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Creating volume a57a7042-c953-4035-ac15-485dd758450f {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:10:26 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:10:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a57a7042-c953-4035-ac15-485dd758450f 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:26 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a57a7042-c953-4035-ac15-485dd758450f 1073741824 Sep 04 16:10:26 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:27 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a57a7042-c953-4035-ac15-485dd758450f 1073741824" returned: 0 in 0.543s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:27 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=298,cinder:SELECT=223,cinder:INSERT=75,cinder:DELETE=26 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:10:27 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=185,cinder:UPDATE=277,cinder:INSERT=75,cinder:DELETE=26 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:10:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a57a7042-c953-4035-ac15-485dd758450f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:27 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a57a7042-c953-4035-ac15-485dd758450f Sep 04 16:10:27 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ca383d1f-2321-4e6c-9143-b94600aafd22 tempest-CinderUnicodeTest-1133348320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:27 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a57a7042-c953-4035-ac15-485dd758450f" returned: 0 in 0.322s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:27 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:10:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ca383d1f-2321-4e6c-9143-b94600aafd22 tempest-CinderUnicodeTest-1133348320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.265s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc029c3a-2d60-4baa-b441-3d59f8e26dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a57a7042-c953-4035-ac15-485dd758450f', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998d9c64-5f62-4cf3-97d6-466ebaee4402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:27 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-ca383d1f-2321-4e6c-9143-b94600aafd22 tempest-CinderUnicodeTest-1133348320 None] Creating offline snapshot 9a35d1a5-22be-4ad7-8549-157009cee516 of volume 226a464f-8172-49f4-8f4e-b676b2c0b747 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:10:27 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Volume volume-a57a7042-c953-4035-ac15-485dd758450f (a57a7042-c953-4035-ac15-485dd758450f): created successfully Sep 04 16:10:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998d9c64-5f62-4cf3-97d6-466ebaee4402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:27 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Flow 'volume_create_manager' (115fe504-ce80-4e96-89f2-7580808d4437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:27 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fdfa5c-6bc6-4c22-9ec4-82d6cf9f297a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ca383d1f-2321-4e6c-9143-b94600aafd22 tempest-CinderUnicodeTest-1133348320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:27 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-62dac7e5-abb9-4aeb-ada1-bfbc66573faa tempest-ProjectReaderTests-492338931 None] Created volume successfully. Sep 04 16:10:27 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747 Sep 04 16:10:27 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:28 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ca383d1f-2321-4e6c-9143-b94600aafd22 tempest-CinderUnicodeTest-1133348320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747" returned: 0 in 0.423s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ca383d1f-2321-4e6c-9143-b94600aafd22 tempest-CinderUnicodeTest-1133348320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.9a35d1a5-22be-4ad7-8549-157009cee516 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:28 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.9a35d1a5-22be-4ad7-8549-157009cee516 1G Sep 04 16:10:28 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:28 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ca383d1f-2321-4e6c-9143-b94600aafd22 tempest-CinderUnicodeTest-1133348320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.9a35d1a5-22be-4ad7-8549-157009cee516 1G" returned: 0 in 0.495s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ca383d1f-2321-4e6c-9143-b94600aafd22 tempest-CinderUnicodeTest-1133348320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-226a464f-8172-49f4-8f4e-b676b2c0b747 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.9a35d1a5-22be-4ad7-8549-157009cee516 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:28 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-226a464f-8172-49f4-8f4e-b676b2c0b747 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.9a35d1a5-22be-4ad7-8549-157009cee516 Sep 04 16:10:28 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9e9cd712-b753-48d2-9bdf-d7fd1d26da50 tempest-ProjectReaderTests-492338931 None] Acquiring lock "cinder-a57a7042-c953-4035-ac15-485dd758450f-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9e9cd712-b753-48d2-9bdf-d7fd1d26da50 tempest-ProjectReaderTests-492338931 None] Lock "cinder-a57a7042-c953-4035-ac15-485dd758450f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9e9cd712-b753-48d2-9bdf-d7fd1d26da50 tempest-ProjectReaderTests-492338931 None] Acquiring lock "cinder-quobyte-a57a7042-c953-4035-ac15-485dd758450f" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9e9cd712-b753-48d2-9bdf-d7fd1d26da50 tempest-ProjectReaderTests-492338931 None] Lock "cinder-quobyte-a57a7042-c953-4035-ac15-485dd758450f" acquired by "delete_volume" :: waited 0.021s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[4731b00c-d6c6-4947-92df-adf3748ef913]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9e9cd712-b753-48d2-9bdf-d7fd1d26da50 tempest-ProjectReaderTests-492338931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a57a7042-c953-4035-ac15-485dd758450f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:29 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ca383d1f-2321-4e6c-9143-b94600aafd22 tempest-CinderUnicodeTest-1133348320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-226a464f-8172-49f4-8f4e-b676b2c0b747 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.9a35d1a5-22be-4ad7-8549-157009cee516" returned: 0 in 0.402s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:29 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-ca383d1f-2321-4e6c-9143-b94600aafd22 tempest-CinderUnicodeTest-1133348320 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.9a35d1a5-22be-4ad7-8549-157009cee516 is being set with open permissions: ugo+rw Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ca383d1f-2321-4e6c-9143-b94600aafd22 tempest-CinderUnicodeTest-1133348320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.9a35d1a5-22be-4ad7-8549-157009cee516 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:29 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a57a7042-c953-4035-ac15-485dd758450f Sep 04 16:10:29 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.9a35d1a5-22be-4ad7-8549-157009cee516 Sep 04 16:10:29 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:29 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:29 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9e9cd712-b753-48d2-9bdf-d7fd1d26da50 tempest-ProjectReaderTests-492338931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a57a7042-c953-4035-ac15-485dd758450f" returned: 0 in 0.497s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9e9cd712-b753-48d2-9bdf-d7fd1d26da50 tempest-ProjectReaderTests-492338931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a57a7042-c953-4035-ac15-485dd758450f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:29 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ca383d1f-2321-4e6c-9143-b94600aafd22 tempest-CinderUnicodeTest-1133348320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.9a35d1a5-22be-4ad7-8549-157009cee516" returned: 0 in 0.410s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:29 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a57a7042-c953-4035-ac15-485dd758450f Sep 04 16:10:29 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ca383d1f-2321-4e6c-9143-b94600aafd22 tempest-CinderUnicodeTest-1133348320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:29 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.info Sep 04 16:10:29 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Flow 'volume_create_manager' (5a289d04-d347-42db-8eaf-8eddc7cfdb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3dcdb0-9788-4f35-bc4f-a8846b796e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3dcdb0-9788-4f35-bc4f-a8846b796e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-335610474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=281d78bf-4775-450b-823c-20b35e090afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e4d51b820b44b4a7a5be87ff0020bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:30Z,use_quota=True,user_id='1903be57da7842f78985ac122b895e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf105db-8090-419f-9b72-13fc89f0ed4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf105db-8090-419f-9b72-13fc89f0ed4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebcce124-f106-4805-bb67-4f57a451031e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebcce124-f106-4805-bb67-4f57a451031e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '281d78bf-4775-450b-823c-20b35e090afd', 'volume_name': 'volume-281d78bf-4775-450b-823c-20b35e090afd', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da201489-fd75-4f63-b954-1d8b157731b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:29 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da201489-fd75-4f63-b954-1d8b157731b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667608dd-c58f-4f67-8ab1-4a56e3cab11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:29 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Volume 281d78bf-4775-450b-823c-20b35e090afd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-281d78bf-4775-450b-823c-20b35e090afd', 'volume_size': 1} Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9e9cd712-b753-48d2-9bdf-d7fd1d26da50 tempest-ProjectReaderTests-492338931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-a57a7042-c953-4035-ac15-485dd758450f" returned: 0 in 0.284s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9e9cd712-b753-48d2-9bdf-d7fd1d26da50 tempest-ProjectReaderTests-492338931 None] Lock "cinder-quobyte-a57a7042-c953-4035-ac15-485dd758450f" released by "delete_volume" :: held 0.829s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:29 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-9e9cd712-b753-48d2-9bdf-d7fd1d26da50 tempest-ProjectReaderTests-492338931 None] Created reservations ['04e98944-705d-41c1-9923-98b08bf23b94', 'c1064458-fa83-44ca-a219-b27753437d6e', 'acc2fe72-5c43-43d8-928a-eee72f7e5103', '310dedd6-1765-4ca2-8ec3-5b5b97b5cf6d'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:30 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ca383d1f-2321-4e6c-9143-b94600aafd22 tempest-CinderUnicodeTest-1133348320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.info" returned: 0 in 0.346s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:30 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-ca383d1f-2321-4e6c-9143-b94600aafd22 tempest-CinderUnicodeTest-1133348320 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.info is being set with open permissions: ugo+rw Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ca383d1f-2321-4e6c-9143-b94600aafd22 tempest-CinderUnicodeTest-1133348320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9e9cd712-b753-48d2-9bdf-d7fd1d26da50 tempest-ProjectReaderTests-492338931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9e9cd712-b753-48d2-9bdf-d7fd1d26da50 tempest-ProjectReaderTests-492338931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9e9cd712-b753-48d2-9bdf-d7fd1d26da50 tempest-ProjectReaderTests-492338931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-9e9cd712-b753-48d2-9bdf-d7fd1d26da50 tempest-ProjectReaderTests-492338931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-9e9cd712-b753-48d2-9bdf-d7fd1d26da50 tempest-ProjectReaderTests-492338931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9e9cd712-b753-48d2-9bdf-d7fd1d26da50 tempest-ProjectReaderTests-492338931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:30 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.info Sep 04 16:10:30 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:30 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:10:30 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:30 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9e9cd712-b753-48d2-9bdf-d7fd1d26da50 tempest-ProjectReaderTests-492338931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.256s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-9e9cd712-b753-48d2-9bdf-d7fd1d26da50 tempest-ProjectReaderTests-492338931 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:10:30 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-9e9cd712-b753-48d2-9bdf-d7fd1d26da50 tempest-ProjectReaderTests-492338931 None] Deleted volume successfully. Sep 04 16:10:30 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ca383d1f-2321-4e6c-9143-b94600aafd22 tempest-CinderUnicodeTest-1133348320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.info" returned: 0 in 0.298s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ca383d1f-2321-4e6c-9143-b94600aafd22 tempest-CinderUnicodeTest-1133348320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.464s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-335610474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=281d78bf-4775-450b-823c-20b35e090afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e4d51b820b44b4a7a5be87ff0020bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:30Z,use_quota=True,user_id='1903be57da7842f78985ac122b895e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Creating volume 281d78bf-4775-450b-823c-20b35e090afd {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:10:30 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9e9cd712-b753-48d2-9bdf-d7fd1d26da50 tempest-ProjectReaderTests-492338931 None] Lock "cinder-a57a7042-c953-4035-ac15-485dd758450f-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:30 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd 1073741824 Sep 04 16:10:30 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:30 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ca383d1f-2321-4e6c-9143-b94600aafd22 tempest-CinderUnicodeTest-1133348320 None] Create snapshot completed successfully Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] Acquiring lock "cinder-9a35d1a5-22be-4ad7-8549-157009cee516-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] Lock "cinder-9a35d1a5-22be-4ad7-8549-157009cee516-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] Acquiring lock "cinder-quobyte-226a464f-8172-49f4-8f4e-b676b2c0b747" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] Lock "cinder-quobyte-226a464f-8172-49f4-8f4e-b676b2c0b747" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] Acquiring lock "cinder-quobyte-9a35d1a5-22be-4ad7-8549-157009cee516" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] Lock "cinder-quobyte-9a35d1a5-22be-4ad7-8549-157009cee516" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] Deleting offline snapshot 9a35d1a5-22be-4ad7-8549-157009cee516 of volume 226a464f-8172-49f4-8f4e-b676b2c0b747 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] snapshot_file for this snap is: volume-226a464f-8172-49f4-8f4e-b676b2c0b747.9a35d1a5-22be-4ad7-8549-157009cee516 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[923bb286-5a83-4a77-ac28-d96b4b59a4f9]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.9a35d1a5-22be-4ad7-8549-157009cee516 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:30 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd 1073741824" returned: 0 in 0.592s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:31 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd Sep 04 16:10:31 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:31 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.9a35d1a5-22be-4ad7-8549-157009cee516 Sep 04 16:10:31 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:31 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd" returned: 0 in 0.273s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:10:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667608dd-c58f-4f67-8ab1-4a56e3cab11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-281d78bf-4775-450b-823c-20b35e090afd', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6c16693-c599-4f1a-a2ae-d3725e2b42df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:31 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Volume volume-281d78bf-4775-450b-823c-20b35e090afd (281d78bf-4775-450b-823c-20b35e090afd): created successfully Sep 04 16:10:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6c16693-c599-4f1a-a2ae-d3725e2b42df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:31 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Flow 'volume_create_manager' (5a289d04-d347-42db-8eaf-8eddc7cfdb88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:31 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-8046c718-06ee-44ce-bf68-599217875c07 tempest-ProjectReaderTests-1423655718 None] Created volume successfully. Sep 04 16:10:31 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.9a35d1a5-22be-4ad7-8549-157009cee516" returned: 0 in 0.523s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-226a464f-8172-49f4-8f4e-b676b2c0b747(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:10:31 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[964dc635-f628-4251-b12f-e906d3208563]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:31 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747 Sep 04 16:10:31 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:31 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747" returned: 0 in 0.433s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.9a35d1a5-22be-4ad7-8549-157009cee516 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:31 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.9a35d1a5-22be-4ad7-8549-157009cee516 Sep 04 16:10:31 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b5cdd8ae-2587-4f30-8a9e-263a4498ed83 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b5cdd8ae-2587-4f30-8a9e-263a4498ed83 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:32 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-b5cdd8ae-2587-4f30-8a9e-263a4498ed83 tempest-ProjectReaderTests-1423655718 None] Creating offline snapshot 1c57a301-dad8-408f-84bf-d2576807940f of volume 281d78bf-4775-450b-823c-20b35e090afd {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:10:32 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[74551bd3-af09-4e2c-96f0-078ed898b4bd]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b5cdd8ae-2587-4f30-8a9e-263a4498ed83 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:32 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd Sep 04 16:10:32 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:32 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.9a35d1a5-22be-4ad7-8549-157009cee516" returned: 0 in 0.416s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.9a35d1a5-22be-4ad7-8549-157009cee516 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:32 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.9a35d1a5-22be-4ad7-8549-157009cee516 Sep 04 16:10:32 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:32 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b5cdd8ae-2587-4f30-8a9e-263a4498ed83 tempest-ProjectReaderTests-1423655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd" returned: 0 in 0.423s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b5cdd8ae-2587-4f30-8a9e-263a4498ed83 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.1c57a301-dad8-408f-84bf-d2576807940f 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:32 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.1c57a301-dad8-408f-84bf-d2576807940f 1G Sep 04 16:10:32 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:32 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747.9a35d1a5-22be-4ad7-8549-157009cee516" returned: 0 in 0.306s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] Lock "cinder-quobyte-9a35d1a5-22be-4ad7-8549-157009cee516" released by "_delete_snapshot" :: held 1.809s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] Lock "cinder-quobyte-226a464f-8172-49f4-8f4e-b676b2c0b747" released by "delete_snapshot" :: held 1.842s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:32 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] Created reservations ['2a6f23b5-7fe3-4ce1-b274-976002413686', 'b0320722-a5fb-4abd-aacd-08468476082c', 'ae8c0daa-a519-45aa-b8c9-343418cdbe59', 'e13b58e5-17da-4998-8b1f-9fe7aa7e1279'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:32 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] Delete snapshot completed successfully. Sep 04 16:10:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9cb9a14f-593f-40db-b7c5-dd90be00f3d9 tempest-CinderUnicodeTest-1133348320 None] Lock "cinder-9a35d1a5-22be-4ad7-8549-157009cee516-delete_snapshot" released by "delete_snapshot" :: held 2.004s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:32 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b5cdd8ae-2587-4f30-8a9e-263a4498ed83 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.1c57a301-dad8-408f-84bf-d2576807940f 1G" returned: 0 in 0.465s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b5cdd8ae-2587-4f30-8a9e-263a4498ed83 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-281d78bf-4775-450b-823c-20b35e090afd -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.1c57a301-dad8-408f-84bf-d2576807940f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c1d35c78-9aff-4f22-be40-fe788aea681e tempest-CinderUnicodeTest-1133348320 None] Acquiring lock "cinder-226a464f-8172-49f4-8f4e-b676b2c0b747-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:32 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-281d78bf-4775-450b-823c-20b35e090afd -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.1c57a301-dad8-408f-84bf-d2576807940f Sep 04 16:10:32 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c1d35c78-9aff-4f22-be40-fe788aea681e tempest-CinderUnicodeTest-1133348320 None] Lock "cinder-226a464f-8172-49f4-8f4e-b676b2c0b747-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:33 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c1d35c78-9aff-4f22-be40-fe788aea681e tempest-CinderUnicodeTest-1133348320 None] Acquiring lock "cinder-quobyte-226a464f-8172-49f4-8f4e-b676b2c0b747" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:33 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c1d35c78-9aff-4f22-be40-fe788aea681e tempest-CinderUnicodeTest-1133348320 None] Lock "cinder-quobyte-226a464f-8172-49f4-8f4e-b676b2c0b747" acquired by "delete_volume" :: waited 0.025s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:33 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[523e603d-eaeb-4afa-817d-7f5673668136]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c1d35c78-9aff-4f22-be40-fe788aea681e tempest-CinderUnicodeTest-1133348320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:33 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747 Sep 04 16:10:33 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:33 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b5cdd8ae-2587-4f30-8a9e-263a4498ed83 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-281d78bf-4775-450b-823c-20b35e090afd -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.1c57a301-dad8-408f-84bf-d2576807940f" returned: 0 in 0.376s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:33 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-b5cdd8ae-2587-4f30-8a9e-263a4498ed83 tempest-ProjectReaderTests-1423655718 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.1c57a301-dad8-408f-84bf-d2576807940f is being set with open permissions: ugo+rw Sep 04 16:10:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b5cdd8ae-2587-4f30-8a9e-263a4498ed83 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.1c57a301-dad8-408f-84bf-d2576807940f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:33 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.1c57a301-dad8-408f-84bf-d2576807940f Sep 04 16:10:33 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:33 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c1d35c78-9aff-4f22-be40-fe788aea681e tempest-CinderUnicodeTest-1133348320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747" returned: 0 in 0.436s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c1d35c78-9aff-4f22-be40-fe788aea681e tempest-CinderUnicodeTest-1133348320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:33 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747 Sep 04 16:10:33 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:33 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b5cdd8ae-2587-4f30-8a9e-263a4498ed83 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.1c57a301-dad8-408f-84bf-d2576807940f" returned: 0 in 0.313s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b5cdd8ae-2587-4f30-8a9e-263a4498ed83 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:33 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.info Sep 04 16:10:33 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:33 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c1d35c78-9aff-4f22-be40-fe788aea681e tempest-CinderUnicodeTest-1133348320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-226a464f-8172-49f4-8f4e-b676b2c0b747" returned: 0 in 0.300s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:33 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c1d35c78-9aff-4f22-be40-fe788aea681e tempest-CinderUnicodeTest-1133348320 None] Lock "cinder-quobyte-226a464f-8172-49f4-8f4e-b676b2c0b747" released by "delete_volume" :: held 0.806s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:33 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-c1d35c78-9aff-4f22-be40-fe788aea681e tempest-CinderUnicodeTest-1133348320 None] Created reservations ['3bc324d3-989c-4560-9ff9-0e8e83870d36', 'b29e0420-7f66-40da-851d-ce148f951c0f', 'e486c532-73ef-440a-a6da-d74392e81f64', '5ad99a63-8b4b-4759-96db-9eab6cdc1abb'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:33 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b5cdd8ae-2587-4f30-8a9e-263a4498ed83 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.info" returned: 0 in 0.295s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:33 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-b5cdd8ae-2587-4f30-8a9e-263a4498ed83 tempest-ProjectReaderTests-1423655718 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.info is being set with open permissions: ugo+rw Sep 04 16:10:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b5cdd8ae-2587-4f30-8a9e-263a4498ed83 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c1d35c78-9aff-4f22-be40-fe788aea681e tempest-CinderUnicodeTest-1133348320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c1d35c78-9aff-4f22-be40-fe788aea681e tempest-CinderUnicodeTest-1133348320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c1d35c78-9aff-4f22-be40-fe788aea681e tempest-CinderUnicodeTest-1133348320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:33 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.info Sep 04 16:10:34 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c1d35c78-9aff-4f22-be40-fe788aea681e tempest-CinderUnicodeTest-1133348320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c1d35c78-9aff-4f22-be40-fe788aea681e tempest-CinderUnicodeTest-1133348320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c1d35c78-9aff-4f22-be40-fe788aea681e tempest-CinderUnicodeTest-1133348320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:34 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:10:34 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-921f01e7-f9b7-4456-9271-8d0bac63974e tempest-CinderUnicodeTest-1133348320 None] Acquiring lock "cinder-d47cb3e0-c062-4747-8997-cca82ea79cad-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-921f01e7-f9b7-4456-9271-8d0bac63974e tempest-CinderUnicodeTest-1133348320 None] Lock "cinder-d47cb3e0-c062-4747-8997-cca82ea79cad-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-921f01e7-f9b7-4456-9271-8d0bac63974e tempest-CinderUnicodeTest-1133348320 None] Acquiring lock "cinder-quobyte-d47cb3e0-c062-4747-8997-cca82ea79cad" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-921f01e7-f9b7-4456-9271-8d0bac63974e tempest-CinderUnicodeTest-1133348320 None] Lock "cinder-quobyte-d47cb3e0-c062-4747-8997-cca82ea79cad" acquired by "delete_volume" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:34 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b5cdd8ae-2587-4f30-8a9e-263a4498ed83 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.info" returned: 0 in 0.274s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b5cdd8ae-2587-4f30-8a9e-263a4498ed83 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.254s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cf5ac6-5627-477c-ba55-40b3a7c81940]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-921f01e7-f9b7-4456-9271-8d0bac63974e tempest-CinderUnicodeTest-1133348320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d47cb3e0-c062-4747-8997-cca82ea79cad {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:34 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c1d35c78-9aff-4f22-be40-fe788aea681e tempest-CinderUnicodeTest-1133348320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.292s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-c1d35c78-9aff-4f22-be40-fe788aea681e tempest-CinderUnicodeTest-1133348320 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:10:34 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b5cdd8ae-2587-4f30-8a9e-263a4498ed83 tempest-ProjectReaderTests-1423655718 None] Create snapshot completed successfully Sep 04 16:10:34 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-c1d35c78-9aff-4f22-be40-fe788aea681e tempest-CinderUnicodeTest-1133348320 None] Deleted volume successfully. Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c1d35c78-9aff-4f22-be40-fe788aea681e tempest-CinderUnicodeTest-1133348320 None] Lock "cinder-226a464f-8172-49f4-8f4e-b676b2c0b747-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:34 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d47cb3e0-c062-4747-8997-cca82ea79cad Sep 04 16:10:34 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:34 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-921f01e7-f9b7-4456-9271-8d0bac63974e tempest-CinderUnicodeTest-1133348320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d47cb3e0-c062-4747-8997-cca82ea79cad" returned: 0 in 0.378s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-921f01e7-f9b7-4456-9271-8d0bac63974e tempest-CinderUnicodeTest-1133348320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d47cb3e0-c062-4747-8997-cca82ea79cad {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:34 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d47cb3e0-c062-4747-8997-cca82ea79cad Sep 04 16:10:34 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:34 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-921f01e7-f9b7-4456-9271-8d0bac63974e tempest-CinderUnicodeTest-1133348320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d47cb3e0-c062-4747-8997-cca82ea79cad" returned: 0 in 0.241s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-921f01e7-f9b7-4456-9271-8d0bac63974e tempest-CinderUnicodeTest-1133348320 None] Lock "cinder-quobyte-d47cb3e0-c062-4747-8997-cca82ea79cad" released by "delete_volume" :: held 0.666s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:34 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-921f01e7-f9b7-4456-9271-8d0bac63974e tempest-CinderUnicodeTest-1133348320 None] Created reservations ['55922743-f4da-407d-86b5-914743c6b8e7', '2f4e0b49-3e42-44dc-9f3a-e10c3dce6bd0', '3e42875d-75a7-4818-8b91-47191e508eb5', 'd0ef6a67-ce44-46de-8d85-3a02a58d7439'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:34 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:10:34 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-921f01e7-f9b7-4456-9271-8d0bac63974e tempest-CinderUnicodeTest-1133348320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-921f01e7-f9b7-4456-9271-8d0bac63974e tempest-CinderUnicodeTest-1133348320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-921f01e7-f9b7-4456-9271-8d0bac63974e tempest-CinderUnicodeTest-1133348320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-921f01e7-f9b7-4456-9271-8d0bac63974e tempest-CinderUnicodeTest-1133348320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-921f01e7-f9b7-4456-9271-8d0bac63974e tempest-CinderUnicodeTest-1133348320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-921f01e7-f9b7-4456-9271-8d0bac63974e tempest-CinderUnicodeTest-1133348320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:35 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:10:35 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:35 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.282s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 28 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 16:10:35 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-921f01e7-f9b7-4456-9271-8d0bac63974e tempest-CinderUnicodeTest-1133348320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.279s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-921f01e7-f9b7-4456-9271-8d0bac63974e tempest-CinderUnicodeTest-1133348320 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:10:35 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-921f01e7-f9b7-4456-9271-8d0bac63974e tempest-CinderUnicodeTest-1133348320 None] Deleted volume successfully. Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-921f01e7-f9b7-4456-9271-8d0bac63974e tempest-CinderUnicodeTest-1133348320 None] Lock "cinder-d47cb3e0-c062-4747-8997-cca82ea79cad-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-1c57a301-dad8-408f-84bf-d2576807940f-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] Lock "cinder-1c57a301-dad8-408f-84bf-d2576807940f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-quobyte-281d78bf-4775-450b-823c-20b35e090afd" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-281d78bf-4775-450b-823c-20b35e090afd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-quobyte-1c57a301-dad8-408f-84bf-d2576807940f" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-1c57a301-dad8-408f-84bf-d2576807940f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] Deleting offline snapshot 1c57a301-dad8-408f-84bf-d2576807940f of volume 281d78bf-4775-450b-823c-20b35e090afd {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] snapshot_file for this snap is: volume-281d78bf-4775-450b-823c-20b35e090afd.1c57a301-dad8-408f-84bf-d2576807940f {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a85490-9d75-4ee9-93bc-572fb2c83e13]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.1c57a301-dad8-408f-84bf-d2576807940f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:35 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.1c57a301-dad8-408f-84bf-d2576807940f Sep 04 16:10:35 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:35 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.1c57a301-dad8-408f-84bf-d2576807940f" returned: 0 in 0.386s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-281d78bf-4775-450b-823c-20b35e090afd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1cc1c1-78fe-4c1d-8734-1c14da8abc3b]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:36 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd Sep 04 16:10:36 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:36 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd" returned: 0 in 0.436s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.1c57a301-dad8-408f-84bf-d2576807940f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:36 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.1c57a301-dad8-408f-84bf-d2576807940f Sep 04 16:10:36 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:36 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.1c57a301-dad8-408f-84bf-d2576807940f" returned: 0 in 0.430s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.1c57a301-dad8-408f-84bf-d2576807940f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:36 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.1c57a301-dad8-408f-84bf-d2576807940f Sep 04 16:10:36 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:37 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd.1c57a301-dad8-408f-84bf-d2576807940f" returned: 0 in 0.308s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:37 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-1c57a301-dad8-408f-84bf-d2576807940f" released by "_delete_snapshot" :: held 1.679s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:37 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-281d78bf-4775-450b-823c-20b35e090afd" released by "delete_snapshot" :: held 1.709s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:37 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] Created reservations ['5ac08b6f-5f9e-4de3-87d0-a5a4b7d9102a', '165f0c3a-9053-4093-a804-64500b8c8f47', '8242b6a3-fdda-461c-9d93-a2a048f78658', 'd8ebde23-fb73-4a43-be1e-c793611498bf'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:37 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] Delete snapshot completed successfully. Sep 04 16:10:37 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-99ea3f5f-c00c-4784-93f6-6c5630239b8e tempest-ProjectReaderTests-1423655718 None] Lock "cinder-1c57a301-dad8-408f-84bf-d2576807940f-delete_snapshot" released by "delete_snapshot" :: held 1.880s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:37 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2b8638d0-547d-4626-a1bb-09e03137b545 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-281d78bf-4775-450b-823c-20b35e090afd-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:37 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2b8638d0-547d-4626-a1bb-09e03137b545 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-281d78bf-4775-450b-823c-20b35e090afd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:37 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2b8638d0-547d-4626-a1bb-09e03137b545 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-quobyte-281d78bf-4775-450b-823c-20b35e090afd" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:37 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2b8638d0-547d-4626-a1bb-09e03137b545 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-281d78bf-4775-450b-823c-20b35e090afd" acquired by "delete_volume" :: waited 0.030s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:37 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[865a9efc-8e57-476d-a01f-6845ff60095c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2b8638d0-547d-4626-a1bb-09e03137b545 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:37 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd Sep 04 16:10:37 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:38 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2b8638d0-547d-4626-a1bb-09e03137b545 tempest-ProjectReaderTests-1423655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd" returned: 0 in 0.391s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2b8638d0-547d-4626-a1bb-09e03137b545 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:38 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd Sep 04 16:10:38 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:38 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2b8638d0-547d-4626-a1bb-09e03137b545 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-281d78bf-4775-450b-823c-20b35e090afd" returned: 0 in 0.284s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2b8638d0-547d-4626-a1bb-09e03137b545 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-281d78bf-4775-450b-823c-20b35e090afd" released by "delete_volume" :: held 0.748s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:38 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-2b8638d0-547d-4626-a1bb-09e03137b545 tempest-ProjectReaderTests-1423655718 None] Created reservations ['fa73af12-fa82-45f2-8df4-32284e5cf402', 'e3720551-8637-4c53-8ec3-6dc590ed2ccd', '952c8ab5-e7a3-4975-ba4f-bdf5a54ab9fd', '4b975758-a216-4b88-af9c-ab009e752a38'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2b8638d0-547d-4626-a1bb-09e03137b545 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2b8638d0-547d-4626-a1bb-09e03137b545 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:38 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2b8638d0-547d-4626-a1bb-09e03137b545 tempest-ProjectReaderTests-1423655718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:38 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2b8638d0-547d-4626-a1bb-09e03137b545 tempest-ProjectReaderTests-1423655718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2b8638d0-547d-4626-a1bb-09e03137b545 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2b8638d0-547d-4626-a1bb-09e03137b545 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:38 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:10:38 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:38 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2b8638d0-547d-4626-a1bb-09e03137b545 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.279s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:38 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-2b8638d0-547d-4626-a1bb-09e03137b545 tempest-ProjectReaderTests-1423655718 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:10:38 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-2b8638d0-547d-4626-a1bb-09e03137b545 tempest-ProjectReaderTests-1423655718 None] Deleted volume successfully. Sep 04 16:10:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2b8638d0-547d-4626-a1bb-09e03137b545 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-281d78bf-4775-450b-823c-20b35e090afd-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Flow 'volume_create_manager' (52dcf609-f46f-4499-9ce2-3b41f59351f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac87e57-2d33-4ea5-a1a1-5184bdfeef7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac87e57-2d33-4ea5-a1a1-5184bdfeef7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-772771433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac27763-aa9f-4250-9234-2a7ce43ab14a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e4d51b820b44b4a7a5be87ff0020bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:39Z,use_quota=True,user_id='1903be57da7842f78985ac122b895e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda0914a-db8c-4584-a1c6-3d52aeeafe8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda0914a-db8c-4584-a1c6-3d52aeeafe8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53009564-0b6b-4151-a488-afcc02aa89d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53009564-0b6b-4151-a488-afcc02aa89d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac27763-aa9f-4250-9234-2a7ce43ab14a', 'volume_name': 'volume-fac27763-aa9f-4250-9234-2a7ce43ab14a', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac58a64-da9a-4638-8164-df5a4cc2aaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac58a64-da9a-4638-8164-df5a4cc2aaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39270d7-7607-4757-8149-9fdfb6d65291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:39 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Volume fac27763-aa9f-4250-9234-2a7ce43ab14a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac27763-aa9f-4250-9234-2a7ce43ab14a', 'volume_size': 1} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-772771433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac27763-aa9f-4250-9234-2a7ce43ab14a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e4d51b820b44b4a7a5be87ff0020bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:39Z,use_quota=True,user_id='1903be57da7842f78985ac122b895e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Creating volume fac27763-aa9f-4250-9234-2a7ce43ab14a {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:10:39 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:39 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a 1073741824 Sep 04 16:10:39 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Flow 'volume_create_manager' (345b5dd3-4f5e-4aea-8fd3-80217423c1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce6a8ec-b379-4b07-8235-3754f1cf36ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce6a8ec-b379-4b07-8235-3754f1cf36ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-842101140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb01159052a40b287cf32491b8d265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:40Z,use_quota=True,user_id='bac5509d617040ee9cc4a5e5f8232b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a1a9ed-eb51-44e0-bc60-915ef77b41de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a1a9ed-eb51-44e0-bc60-915ef77b41de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc241f88-9b85-4765-a713-b834e5267973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc241f88-9b85-4765-a713-b834e5267973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a', 'volume_name': 'volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15914f7-ed99-440f-a9cc-7f2c9f113b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15914f7-ed99-440f-a9cc-7f2c9f113b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e25df56-4987-4762-b245-fe858996b8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:39 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Volume 30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a', 'volume_size': 1} Sep 04 16:10:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:40 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a 1073741824" returned: 0 in 0.493s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:40 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a Sep 04 16:10:40 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:40 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a" returned: 0 in 0.284s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:10:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.429s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-842101140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb01159052a40b287cf32491b8d265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:40Z,use_quota=True,user_id='bac5509d617040ee9cc4a5e5f8232b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:10:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Creating volume 30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:10:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:40 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:10:40 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:10:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39270d7-7607-4757-8149-9fdfb6d65291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac27763-aa9f-4250-9234-2a7ce43ab14a', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:40 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a 1073741824 Sep 04 16:10:40 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fbe58a1-8c5e-4a15-9b89-40c2eb7c6b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:40 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Volume volume-fac27763-aa9f-4250-9234-2a7ce43ab14a (fac27763-aa9f-4250-9234-2a7ce43ab14a): created successfully Sep 04 16:10:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fbe58a1-8c5e-4a15-9b89-40c2eb7c6b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:40 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Flow 'volume_create_manager' (52dcf609-f46f-4499-9ce2-3b41f59351f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:40 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-6b578829-e4f9-43f2-9b70-afdb0b474421 tempest-ProjectReaderTests-1423655718 None] Created volume successfully. Sep 04 16:10:40 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a 1073741824" returned: 0 in 0.474s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:40 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a Sep 04 16:10:40 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:41 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a" returned: 0 in 0.233s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:41 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:10:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:41 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e25df56-4987-4762-b245-fe858996b8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:41 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb014fab-fa2c-434d-9c99-7903bf3377f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:41 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Volume volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a (30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a): created successfully Sep 04 16:10:41 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb014fab-fa2c-434d-9c99-7903bf3377f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:41 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Flow 'volume_create_manager' (345b5dd3-4f5e-4aea-8fd3-80217423c1ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:41 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-09a76d4f-7664-404d-a6b2-706e7ce56f72 tempest-ProjectMemberTests-2060754872 None] Created volume successfully. Sep 04 16:10:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dc6a9f3d-95fa-4ae0-b01b-95edcc345c0b tempest-ProjectReaderTests-1423655718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dc6a9f3d-95fa-4ae0-b01b-95edcc345c0b tempest-ProjectReaderTests-1423655718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:41 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-dc6a9f3d-95fa-4ae0-b01b-95edcc345c0b tempest-ProjectReaderTests-1423655718 None] Creating offline snapshot 3349ed02-9dac-49e8-ac2b-7c1a9f38fed7 of volume fac27763-aa9f-4250-9234-2a7ce43ab14a {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:10:41 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f540b53f-a9c9-4b4c-a7ae-dd8743bca73b]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dc6a9f3d-95fa-4ae0-b01b-95edcc345c0b tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:41 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a Sep 04 16:10:41 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:42 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dc6a9f3d-95fa-4ae0-b01b-95edcc345c0b tempest-ProjectReaderTests-1423655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a" returned: 0 in 0.393s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dc6a9f3d-95fa-4ae0-b01b-95edcc345c0b tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.3349ed02-9dac-49e8-ac2b-7c1a9f38fed7 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:42 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.3349ed02-9dac-49e8-ac2b-7c1a9f38fed7 1G Sep 04 16:10:42 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8888d3c4-209b-47d4-bfe4-3f5e719f9b1e tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:42 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dc6a9f3d-95fa-4ae0-b01b-95edcc345c0b tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.3349ed02-9dac-49e8-ac2b-7c1a9f38fed7 1G" returned: 0 in 0.477s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dc6a9f3d-95fa-4ae0-b01b-95edcc345c0b tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fac27763-aa9f-4250-9234-2a7ce43ab14a -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.3349ed02-9dac-49e8-ac2b-7c1a9f38fed7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:42 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fac27763-aa9f-4250-9234-2a7ce43ab14a -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.3349ed02-9dac-49e8-ac2b-7c1a9f38fed7 Sep 04 16:10:42 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:42 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dc6a9f3d-95fa-4ae0-b01b-95edcc345c0b tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fac27763-aa9f-4250-9234-2a7ce43ab14a -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.3349ed02-9dac-49e8-ac2b-7c1a9f38fed7" returned: 0 in 0.307s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:42 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-dc6a9f3d-95fa-4ae0-b01b-95edcc345c0b tempest-ProjectReaderTests-1423655718 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.3349ed02-9dac-49e8-ac2b-7c1a9f38fed7 is being set with open permissions: ugo+rw Sep 04 16:10:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dc6a9f3d-95fa-4ae0-b01b-95edcc345c0b tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.3349ed02-9dac-49e8-ac2b-7c1a9f38fed7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:42 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.3349ed02-9dac-49e8-ac2b-7c1a9f38fed7 Sep 04 16:10:42 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:43 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dc6a9f3d-95fa-4ae0-b01b-95edcc345c0b tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.3349ed02-9dac-49e8-ac2b-7c1a9f38fed7" returned: 0 in 0.241s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dc6a9f3d-95fa-4ae0-b01b-95edcc345c0b tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:43 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.info Sep 04 16:10:43 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:43 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dc6a9f3d-95fa-4ae0-b01b-95edcc345c0b tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.info" returned: 0 in 0.257s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:43 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-dc6a9f3d-95fa-4ae0-b01b-95edcc345c0b tempest-ProjectReaderTests-1423655718 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.info is being set with open permissions: ugo+rw Sep 04 16:10:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dc6a9f3d-95fa-4ae0-b01b-95edcc345c0b tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:43 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.info Sep 04 16:10:43 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:43 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dc6a9f3d-95fa-4ae0-b01b-95edcc345c0b tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.info" returned: 0 in 0.257s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dc6a9f3d-95fa-4ae0-b01b-95edcc345c0b tempest-ProjectReaderTests-1423655718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.022s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8888d3c4-209b-47d4-bfe4-3f5e719f9b1e tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.293s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-8888d3c4-209b-47d4-bfe4-3f5e719f9b1e tempest-ProjectMemberTests-2060754872 None] Creating offline snapshot 50a61757-d26f-4535-a091-b278240bdb3f of volume 30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:10:43 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-dc6a9f3d-95fa-4ae0-b01b-95edcc345c0b tempest-ProjectReaderTests-1423655718 None] Create snapshot completed successfully Sep 04 16:10:43 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1d87a0-356d-43ea-b113-2481c041a440]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8888d3c4-209b-47d4-bfe4-3f5e719f9b1e tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:43 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a Sep 04 16:10:43 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:44 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8888d3c4-209b-47d4-bfe4-3f5e719f9b1e tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a" returned: 0 in 0.394s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8888d3c4-209b-47d4-bfe4-3f5e719f9b1e tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.50a61757-d26f-4535-a091-b278240bdb3f 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:44 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.50a61757-d26f-4535-a091-b278240bdb3f 1G Sep 04 16:10:44 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:44 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8888d3c4-209b-47d4-bfe4-3f5e719f9b1e tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.50a61757-d26f-4535-a091-b278240bdb3f 1G" returned: 0 in 0.454s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8888d3c4-209b-47d4-bfe4-3f5e719f9b1e tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.50a61757-d26f-4535-a091-b278240bdb3f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:44 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.50a61757-d26f-4535-a091-b278240bdb3f Sep 04 16:10:44 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-3349ed02-9dac-49e8-ac2b-7c1a9f38fed7-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-3349ed02-9dac-49e8-ac2b-7c1a9f38fed7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-quobyte-fac27763-aa9f-4250-9234-2a7ce43ab14a" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-fac27763-aa9f-4250-9234-2a7ce43ab14a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-quobyte-3349ed02-9dac-49e8-ac2b-7c1a9f38fed7" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:44 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:44 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-3349ed02-9dac-49e8-ac2b-7c1a9f38fed7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] Deleting offline snapshot 3349ed02-9dac-49e8-ac2b-7c1a9f38fed7 of volume fac27763-aa9f-4250-9234-2a7ce43ab14a {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:10:44 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] snapshot_file for this snap is: volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.3349ed02-9dac-49e8-ac2b-7c1a9f38fed7 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:10:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8888d3c4-209b-47d4-bfe4-3f5e719f9b1e tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.50a61757-d26f-4535-a091-b278240bdb3f" returned: 0 in 0.364s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:44 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-8888d3c4-209b-47d4-bfe4-3f5e719f9b1e tempest-ProjectMemberTests-2060754872 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.50a61757-d26f-4535-a091-b278240bdb3f is being set with open permissions: ugo+rw Sep 04 16:10:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8888d3c4-209b-47d4-bfe4-3f5e719f9b1e tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.50a61757-d26f-4535-a091-b278240bdb3f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:44 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[814ae88f-479c-477b-b542-f4c90ba23a8f]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.3349ed02-9dac-49e8-ac2b-7c1a9f38fed7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:45 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.50a61757-d26f-4535-a091-b278240bdb3f Sep 04 16:10:45 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:45 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.3349ed02-9dac-49e8-ac2b-7c1a9f38fed7 Sep 04 16:10:45 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:45 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8888d3c4-209b-47d4-bfe4-3f5e719f9b1e tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.50a61757-d26f-4535-a091-b278240bdb3f" returned: 0 in 0.281s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8888d3c4-209b-47d4-bfe4-3f5e719f9b1e tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:45 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.info Sep 04 16:10:45 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:45 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.3349ed02-9dac-49e8-ac2b-7c1a9f38fed7" returned: 0 in 0.394s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fac27763-aa9f-4250-9234-2a7ce43ab14a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:10:45 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36fa077-5d99-422c-a8fb-fa3cef2e6321]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:45 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a Sep 04 16:10:45 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:45 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8888d3c4-209b-47d4-bfe4-3f5e719f9b1e tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.info" returned: 0 in 0.300s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:45 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-8888d3c4-209b-47d4-bfe4-3f5e719f9b1e tempest-ProjectMemberTests-2060754872 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.info is being set with open permissions: ugo+rw Sep 04 16:10:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8888d3c4-209b-47d4-bfe4-3f5e719f9b1e tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:45 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.info Sep 04 16:10:45 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:45 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a" returned: 0 in 0.397s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.3349ed02-9dac-49e8-ac2b-7c1a9f38fed7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:45 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.3349ed02-9dac-49e8-ac2b-7c1a9f38fed7 Sep 04 16:10:45 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:45 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-8888d3c4-209b-47d4-bfe4-3f5e719f9b1e tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.info" returned: 0 in 0.271s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-8888d3c4-209b-47d4-bfe4-3f5e719f9b1e tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.184s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:45 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-8888d3c4-209b-47d4-bfe4-3f5e719f9b1e tempest-ProjectMemberTests-2060754872 None] Create snapshot completed successfully Sep 04 16:10:46 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.3349ed02-9dac-49e8-ac2b-7c1a9f38fed7" returned: 0 in 0.330s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.3349ed02-9dac-49e8-ac2b-7c1a9f38fed7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:46 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.3349ed02-9dac-49e8-ac2b-7c1a9f38fed7 Sep 04 16:10:46 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:46 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a.3349ed02-9dac-49e8-ac2b-7c1a9f38fed7" returned: 0 in 0.254s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-3349ed02-9dac-49e8-ac2b-7c1a9f38fed7" released by "_delete_snapshot" :: held 1.492s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-fac27763-aa9f-4250-9234-2a7ce43ab14a" released by "delete_snapshot" :: held 1.515s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:46 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] Created reservations ['b7c9318a-e151-46d4-a70c-d69f095a7e16', 'bad3332f-847b-4174-9ffe-62ad615a1b7d', 'b0162641-7a45-45fc-bf43-da65a42e1c92', '13db4308-e847-4162-b275-cfe816e5828d'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:46 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] Delete snapshot completed successfully. Sep 04 16:10:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5e3db197-68f2-4492-95f4-8516d1a12b21 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-3349ed02-9dac-49e8-ac2b-7c1a9f38fed7-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-50a61757-d26f-4535-a091-b278240bdb3f-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-50a61757-d26f-4535-a091-b278240bdb3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-50a61757-d26f-4535-a091-b278240bdb3f" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-50a61757-d26f-4535-a091-b278240bdb3f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] Deleting offline snapshot 50a61757-d26f-4535-a091-b278240bdb3f of volume 30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:10:46 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] snapshot_file for this snap is: volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.50a61757-d26f-4535-a091-b278240bdb3f {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:10:46 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd95fb3-fc84-4edf-b5b9-d3f23d146e59]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.50a61757-d26f-4535-a091-b278240bdb3f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:46 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.50a61757-d26f-4535-a091-b278240bdb3f Sep 04 16:10:46 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:47 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2eed645e-4eeb-4356-ab07-8f68bafbe7d1 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-fac27763-aa9f-4250-9234-2a7ce43ab14a-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.50a61757-d26f-4535-a091-b278240bdb3f" returned: 0 in 0.384s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:47 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:10:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2eed645e-4eeb-4356-ab07-8f68bafbe7d1 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-fac27763-aa9f-4250-9234-2a7ce43ab14a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:47 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5e5e8a-bf84-4e38-96f7-5f534af76596]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2eed645e-4eeb-4356-ab07-8f68bafbe7d1 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-quobyte-fac27763-aa9f-4250-9234-2a7ce43ab14a" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2eed645e-4eeb-4356-ab07-8f68bafbe7d1 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-fac27763-aa9f-4250-9234-2a7ce43ab14a" acquired by "delete_volume" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:47 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[852d1c74-e943-4b5b-b43d-245db01a3bf7]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2eed645e-4eeb-4356-ab07-8f68bafbe7d1 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:47 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a Sep 04 16:10:47 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:47 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a Sep 04 16:10:47 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:47 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a" returned: 0 in 0.407s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.50a61757-d26f-4535-a091-b278240bdb3f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:47 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.50a61757-d26f-4535-a091-b278240bdb3f Sep 04 16:10:47 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:47 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2eed645e-4eeb-4356-ab07-8f68bafbe7d1 tempest-ProjectReaderTests-1423655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a" returned: 0 in 0.392s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2eed645e-4eeb-4356-ab07-8f68bafbe7d1 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:47 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a Sep 04 16:10:47 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:47 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.50a61757-d26f-4535-a091-b278240bdb3f" returned: 0 in 0.354s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.50a61757-d26f-4535-a091-b278240bdb3f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:47 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2eed645e-4eeb-4356-ab07-8f68bafbe7d1 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-fac27763-aa9f-4250-9234-2a7ce43ab14a" returned: 0 in 0.273s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:47 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.50a61757-d26f-4535-a091-b278240bdb3f Sep 04 16:10:47 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2eed645e-4eeb-4356-ab07-8f68bafbe7d1 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-fac27763-aa9f-4250-9234-2a7ce43ab14a" released by "delete_volume" :: held 0.738s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:47 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-2eed645e-4eeb-4356-ab07-8f68bafbe7d1 tempest-ProjectReaderTests-1423655718 None] Created reservations ['ccaa2fd1-4eef-4dc5-ac60-8964de7d18d0', 'd28bd944-e050-4fb1-b633-73038dffb198', '03cb1ab1-1616-42eb-af40-96da860417ed', '6bf86f7b-608e-4f31-bbc8-39d9556943df'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2eed645e-4eeb-4356-ab07-8f68bafbe7d1 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2eed645e-4eeb-4356-ab07-8f68bafbe7d1 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2eed645e-4eeb-4356-ab07-8f68bafbe7d1 tempest-ProjectReaderTests-1423655718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2eed645e-4eeb-4356-ab07-8f68bafbe7d1 tempest-ProjectReaderTests-1423655718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2eed645e-4eeb-4356-ab07-8f68bafbe7d1 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2eed645e-4eeb-4356-ab07-8f68bafbe7d1 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:48 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:10:48 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:48 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a.50a61757-d26f-4535-a091-b278240bdb3f" returned: 0 in 0.255s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-50a61757-d26f-4535-a091-b278240bdb3f" released by "_delete_snapshot" :: held 1.545s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a" released by "delete_snapshot" :: held 1.572s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] Created reservations ['fb201cf7-f12a-42d7-b7da-018e83019d19', 'a51e1b36-0ae7-423b-8bd9-bdc5ba812d3c', 'c7e6c953-3d06-4677-95fc-ddd3ed780f4f', 'c287e1de-dba6-4199-82d2-35f4adc19716'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:48 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2eed645e-4eeb-4356-ab07-8f68bafbe7d1 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.291s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-2eed645e-4eeb-4356-ab07-8f68bafbe7d1 tempest-ProjectReaderTests-1423655718 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:10:48 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-2eed645e-4eeb-4356-ab07-8f68bafbe7d1 tempest-ProjectReaderTests-1423655718 None] Deleted volume successfully. Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-2eed645e-4eeb-4356-ab07-8f68bafbe7d1 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-fac27763-aa9f-4250-9234-2a7ce43ab14a-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:48 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] Delete snapshot completed successfully. Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ddb14ae0-7e6d-4dec-9841-83460e752cc5 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-50a61757-d26f-4535-a091-b278240bdb3f-delete_snapshot" released by "delete_snapshot" :: held 1.791s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Flow 'volume_create_manager' (f5dcb515-a710-4cd5-a875-84a0ed88e775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d9ded75-d1fd-4175-a16a-3662314bb7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5c1f285a-a4b8-4131-b439-e19c5ec3083b tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d9ded75-d1fd-4175-a16a-3662314bb7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429892545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee39dc1-8207-444c-bb0a-6cdbfed1c087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e4d51b820b44b4a7a5be87ff0020bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:49Z,use_quota=True,user_id='1903be57da7842f78985ac122b895e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546bcff0-5523-4d46-8fe5-1ef8c7c8fe4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546bcff0-5523-4d46-8fe5-1ef8c7c8fe4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5a364f-5118-491b-a6a3-98af402dee32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5a364f-5118-491b-a6a3-98af402dee32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ee39dc1-8207-444c-bb0a-6cdbfed1c087', 'volume_name': 'volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0036fcd8-a234-4343-8fe0-dfd1c45bbf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0036fcd8-a234-4343-8fe0-dfd1c45bbf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e8f1f0-911a-4d6e-9edc-1fd64ae1e633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:48 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Volume 2ee39dc1-8207-444c-bb0a-6cdbfed1c087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087', 'volume_size': 1} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429892545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee39dc1-8207-444c-bb0a-6cdbfed1c087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e4d51b820b44b4a7a5be87ff0020bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:49Z,use_quota=True,user_id='1903be57da7842f78985ac122b895e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Creating volume 2ee39dc1-8207-444c-bb0a-6cdbfed1c087 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:10:48 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5c1f285a-a4b8-4131-b439-e19c5ec3083b tempest-ProjectMemberTests-2060754872 None] Lock "cinder-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:48 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087 1073741824 Sep 04 16:10:48 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5c1f285a-a4b8-4131-b439-e19c5ec3083b tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5c1f285a-a4b8-4131-b439-e19c5ec3083b tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a" acquired by "delete_volume" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c647990-d4db-458e-8e7e-2195f09b2e95]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5c1f285a-a4b8-4131-b439-e19c5ec3083b tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:49 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a Sep 04 16:10:49 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:49 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087 1073741824" returned: 0 in 0.451s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:49 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087 Sep 04 16:10:49 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:49 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5c1f285a-a4b8-4131-b439-e19c5ec3083b tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a" returned: 0 in 0.459s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5c1f285a-a4b8-4131-b439-e19c5ec3083b tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:49 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a Sep 04 16:10:49 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:49 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087" returned: 0 in 0.329s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:49 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e8f1f0-911a-4d6e-9edc-1fd64ae1e633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bb232f-964d-4a21-aaaa-92a969816679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5c1f285a-a4b8-4131-b439-e19c5ec3083b tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a" returned: 0 in 0.281s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5c1f285a-a4b8-4131-b439-e19c5ec3083b tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a" released by "delete_volume" :: held 0.821s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:49 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Volume volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087 (2ee39dc1-8207-444c-bb0a-6cdbfed1c087): created successfully Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bb232f-964d-4a21-aaaa-92a969816679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Flow 'volume_create_manager' (f5dcb515-a710-4cd5-a875-84a0ed88e775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:49 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e019cb87-2813-4443-aea0-f7c0a6e4a8b9 tempest-ProjectReaderTests-1423655718 None] Created volume successfully. Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-5c1f285a-a4b8-4131-b439-e19c5ec3083b tempest-ProjectMemberTests-2060754872 None] Created reservations ['f547c777-37c2-4122-87ca-611db6dfc797', '2379976a-469e-4a50-9bed-da8a01902068', '0b1c54c9-1158-44eb-82a8-44bb7e869d2e', '4bf158e1-3ef7-4448-af3f-6b9f581e3e2a'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5c1f285a-a4b8-4131-b439-e19c5ec3083b tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5c1f285a-a4b8-4131-b439-e19c5ec3083b tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5c1f285a-a4b8-4131-b439-e19c5ec3083b tempest-ProjectMemberTests-2060754872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-5c1f285a-a4b8-4131-b439-e19c5ec3083b tempest-ProjectMemberTests-2060754872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5c1f285a-a4b8-4131-b439-e19c5ec3083b tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5c1f285a-a4b8-4131-b439-e19c5ec3083b tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:49 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:10:49 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:50 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5c1f285a-a4b8-4131-b439-e19c5ec3083b tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.256s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-5c1f285a-a4b8-4131-b439-e19c5ec3083b tempest-ProjectMemberTests-2060754872 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:10:50 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-5c1f285a-a4b8-4131-b439-e19c5ec3083b tempest-ProjectMemberTests-2060754872 None] Deleted volume successfully. Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-5c1f285a-a4b8-4131-b439-e19c5ec3083b tempest-ProjectMemberTests-2060754872 None] Lock "cinder-30f22e6a-1c94-4cbc-9a74-0a4d5745ba5a-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Flow 'volume_create_manager' (527472f4-5efb-48e5-930f-65bfb9173a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b8a820-e80b-4a56-ac1a-bd0cd01937db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b8a820-e80b-4a56-ac1a-bd0cd01937db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-5684302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4713a680-7917-44f9-a89b-4b754016a788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb01159052a40b287cf32491b8d265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:50Z,use_quota=True,user_id='bac5509d617040ee9cc4a5e5f8232b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37eac516-fa0e-47e0-b0ad-d3c49771cd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37eac516-fa0e-47e0-b0ad-d3c49771cd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857e6f79-5f60-4f8b-b880-0203805d9de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857e6f79-5f60-4f8b-b880-0203805d9de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4713a680-7917-44f9-a89b-4b754016a788', 'volume_name': 'volume-4713a680-7917-44f9-a89b-4b754016a788', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11ae1b9b-0922-4bc5-bb09-76a75d32ed8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11ae1b9b-0922-4bc5-bb09-76a75d32ed8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (132640f4-3ff5-40db-9554-693f4c99be8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:50 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Volume 4713a680-7917-44f9-a89b-4b754016a788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4713a680-7917-44f9-a89b-4b754016a788', 'volume_size': 1} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-5684302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4713a680-7917-44f9-a89b-4b754016a788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb01159052a40b287cf32491b8d265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:50Z,use_quota=True,user_id='bac5509d617040ee9cc4a5e5f8232b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Creating volume 4713a680-7917-44f9-a89b-4b754016a788 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:10:50 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:10:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:50 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788 1073741824 Sep 04 16:10:50 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7432df9b-5e57-4b22-8315-e519c3f797e8 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:51 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788 1073741824" returned: 0 in 0.499s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:51 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788 Sep 04 16:10:51 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:51 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788" returned: 0 in 0.241s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:10:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7432df9b-5e57-4b22-8315-e519c3f797e8 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.295s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:51 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-7432df9b-5e57-4b22-8315-e519c3f797e8 tempest-ProjectReaderTests-1423655718 None] Creating offline snapshot 4bb4d190-c07d-4313-8994-1e6aecc508e8 of volume 2ee39dc1-8207-444c-bb0a-6cdbfed1c087 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:10:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (132640f4-3ff5-40db-9554-693f4c99be8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4713a680-7917-44f9-a89b-4b754016a788', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f95ff67-36b0-4f86-a56e-dfc4a0074492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:51 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a994b39-5177-4ac3-97a2-0942f786c511]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7432df9b-5e57-4b22-8315-e519c3f797e8 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:51 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Volume volume-4713a680-7917-44f9-a89b-4b754016a788 (4713a680-7917-44f9-a89b-4b754016a788): created successfully Sep 04 16:10:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f95ff67-36b0-4f86-a56e-dfc4a0074492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:51 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Flow 'volume_create_manager' (527472f4-5efb-48e5-930f-65bfb9173a20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:51 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-0090924d-ce2f-4ad9-8ef8-b73010e380da tempest-ProjectMemberTests-2060754872 None] Created volume successfully. Sep 04 16:10:51 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087 Sep 04 16:10:51 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:51 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7432df9b-5e57-4b22-8315-e519c3f797e8 tempest-ProjectReaderTests-1423655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087" returned: 0 in 0.392s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7432df9b-5e57-4b22-8315-e519c3f797e8 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.4bb4d190-c07d-4313-8994-1e6aecc508e8 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:51 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.4bb4d190-c07d-4313-8994-1e6aecc508e8 1G Sep 04 16:10:51 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:52 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7432df9b-5e57-4b22-8315-e519c3f797e8 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.4bb4d190-c07d-4313-8994-1e6aecc508e8 1G" returned: 0 in 0.409s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7432df9b-5e57-4b22-8315-e519c3f797e8 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.4bb4d190-c07d-4313-8994-1e6aecc508e8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:52 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.4bb4d190-c07d-4313-8994-1e6aecc508e8 Sep 04 16:10:52 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:52 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7432df9b-5e57-4b22-8315-e519c3f797e8 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.4bb4d190-c07d-4313-8994-1e6aecc508e8" returned: 0 in 0.302s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:52 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-7432df9b-5e57-4b22-8315-e519c3f797e8 tempest-ProjectReaderTests-1423655718 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.4bb4d190-c07d-4313-8994-1e6aecc508e8 is being set with open permissions: ugo+rw Sep 04 16:10:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7432df9b-5e57-4b22-8315-e519c3f797e8 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.4bb4d190-c07d-4313-8994-1e6aecc508e8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:52 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.4bb4d190-c07d-4313-8994-1e6aecc508e8 Sep 04 16:10:52 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:52 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7432df9b-5e57-4b22-8315-e519c3f797e8 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.4bb4d190-c07d-4313-8994-1e6aecc508e8" returned: 0 in 0.276s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b6f5c5b9-1758-492c-a216-220f40e3ff89 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7432df9b-5e57-4b22-8315-e519c3f797e8 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:52 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.info Sep 04 16:10:52 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:53 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7432df9b-5e57-4b22-8315-e519c3f797e8 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.info" returned: 0 in 0.349s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:53 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-7432df9b-5e57-4b22-8315-e519c3f797e8 tempest-ProjectReaderTests-1423655718 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.info is being set with open permissions: ugo+rw Sep 04 16:10:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7432df9b-5e57-4b22-8315-e519c3f797e8 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:53 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.info Sep 04 16:10:53 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:53 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7432df9b-5e57-4b22-8315-e519c3f797e8 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.info" returned: 0 in 0.255s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7432df9b-5e57-4b22-8315-e519c3f797e8 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.083s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b6f5c5b9-1758-492c-a216-220f40e3ff89 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.635s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:53 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-b6f5c5b9-1758-492c-a216-220f40e3ff89 tempest-ProjectMemberTests-2060754872 None] Creating offline snapshot 4457144c-9a05-4c04-9b1d-85583ca31242 of volume 4713a680-7917-44f9-a89b-4b754016a788 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:10:53 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-7432df9b-5e57-4b22-8315-e519c3f797e8 tempest-ProjectReaderTests-1423655718 None] Create snapshot completed successfully Sep 04 16:10:53 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c8d118-974f-4869-8f20-3723cd59d83d]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f5c5b9-1758-492c-a216-220f40e3ff89 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:53 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788 Sep 04 16:10:53 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:53 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f5c5b9-1758-492c-a216-220f40e3ff89 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788" returned: 0 in 0.374s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f5c5b9-1758-492c-a216-220f40e3ff89 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.4457144c-9a05-4c04-9b1d-85583ca31242 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:53 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.4457144c-9a05-4c04-9b1d-85583ca31242 1G Sep 04 16:10:53 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-4bb4d190-c07d-4313-8994-1e6aecc508e8-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] Lock "cinder-4bb4d190-c07d-4313-8994-1e6aecc508e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-quobyte-2ee39dc1-8207-444c-bb0a-6cdbfed1c087" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-2ee39dc1-8207-444c-bb0a-6cdbfed1c087" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-quobyte-4bb4d190-c07d-4313-8994-1e6aecc508e8" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-4bb4d190-c07d-4313-8994-1e6aecc508e8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:54 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] Deleting offline snapshot 4bb4d190-c07d-4313-8994-1e6aecc508e8 of volume 2ee39dc1-8207-444c-bb0a-6cdbfed1c087 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:10:54 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] snapshot_file for this snap is: volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.4bb4d190-c07d-4313-8994-1e6aecc508e8 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:10:54 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:54 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81a0255-10a9-4b79-857b-97b22a38c285]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.4bb4d190-c07d-4313-8994-1e6aecc508e8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f5c5b9-1758-492c-a216-220f40e3ff89 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.4457144c-9a05-4c04-9b1d-85583ca31242 1G" returned: 0 in 0.518s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f5c5b9-1758-492c-a216-220f40e3ff89 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4713a680-7917-44f9-a89b-4b754016a788 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.4457144c-9a05-4c04-9b1d-85583ca31242 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:54 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4713a680-7917-44f9-a89b-4b754016a788 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.4457144c-9a05-4c04-9b1d-85583ca31242 Sep 04 16:10:54 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:54 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.4bb4d190-c07d-4313-8994-1e6aecc508e8 Sep 04 16:10:54 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:54 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f5c5b9-1758-492c-a216-220f40e3ff89 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4713a680-7917-44f9-a89b-4b754016a788 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.4457144c-9a05-4c04-9b1d-85583ca31242" returned: 0 in 0.309s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:54 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-b6f5c5b9-1758-492c-a216-220f40e3ff89 tempest-ProjectMemberTests-2060754872 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.4457144c-9a05-4c04-9b1d-85583ca31242 is being set with open permissions: ugo+rw Sep 04 16:10:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f5c5b9-1758-492c-a216-220f40e3ff89 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.4457144c-9a05-4c04-9b1d-85583ca31242 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:54 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.4457144c-9a05-4c04-9b1d-85583ca31242 Sep 04 16:10:54 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:54 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.4bb4d190-c07d-4313-8994-1e6aecc508e8" returned: 0 in 0.388s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:54 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:10:54 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3f3ac2-4e5b-4b69-abac-1901bf184c81]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:54 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087 Sep 04 16:10:54 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:54 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f5c5b9-1758-492c-a216-220f40e3ff89 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.4457144c-9a05-4c04-9b1d-85583ca31242" returned: 0 in 0.297s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f5c5b9-1758-492c-a216-220f40e3ff89 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:55 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.info Sep 04 16:10:55 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:55 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087" returned: 0 in 0.416s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.4bb4d190-c07d-4313-8994-1e6aecc508e8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:55 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.4bb4d190-c07d-4313-8994-1e6aecc508e8 Sep 04 16:10:55 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:55 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f5c5b9-1758-492c-a216-220f40e3ff89 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.info" returned: 0 in 0.279s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:55 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-b6f5c5b9-1758-492c-a216-220f40e3ff89 tempest-ProjectMemberTests-2060754872 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.info is being set with open permissions: ugo+rw Sep 04 16:10:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f5c5b9-1758-492c-a216-220f40e3ff89 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:55 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.info Sep 04 16:10:55 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:55 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-b6f5c5b9-1758-492c-a216-220f40e3ff89 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.info" returned: 0 in 0.268s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:55 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-b6f5c5b9-1758-492c-a216-220f40e3ff89 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.152s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.4bb4d190-c07d-4313-8994-1e6aecc508e8" returned: 0 in 0.386s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.4bb4d190-c07d-4313-8994-1e6aecc508e8 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:55 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.4bb4d190-c07d-4313-8994-1e6aecc508e8 Sep 04 16:10:55 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:55 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-b6f5c5b9-1758-492c-a216-220f40e3ff89 tempest-ProjectMemberTests-2060754872 None] Create snapshot completed successfully Sep 04 16:10:55 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087.4bb4d190-c07d-4313-8994-1e6aecc508e8" returned: 0 in 0.234s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-4bb4d190-c07d-4313-8994-1e6aecc508e8" released by "_delete_snapshot" :: held 1.539s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-2ee39dc1-8207-444c-bb0a-6cdbfed1c087" released by "delete_snapshot" :: held 1.566s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-4457144c-9a05-4c04-9b1d-85583ca31242-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:55 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] Created reservations ['fcd8770c-0b2e-4e4f-b67d-b6bb0f587238', 'ac57e0f6-26c4-4603-981c-e70721f66437', 'd5361c69-cc91-494a-982e-d1ca0a113d56', '49cdf568-67f9-44cf-afc6-d99356eb8e77'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-4457144c-9a05-4c04-9b1d-85583ca31242-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-4713a680-7917-44f9-a89b-4b754016a788" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-4713a680-7917-44f9-a89b-4b754016a788" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-4457144c-9a05-4c04-9b1d-85583ca31242" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-4457144c-9a05-4c04-9b1d-85583ca31242" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] Deleting offline snapshot 4457144c-9a05-4c04-9b1d-85583ca31242 of volume 4713a680-7917-44f9-a89b-4b754016a788 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:10:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] snapshot_file for this snap is: volume-4713a680-7917-44f9-a89b-4b754016a788.4457144c-9a05-4c04-9b1d-85583ca31242 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:10:56 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[64526613-bcfb-4a45-aaea-0e19f47f4b39]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.4457144c-9a05-4c04-9b1d-85583ca31242 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:56 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] Delete snapshot completed successfully. Sep 04 16:10:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e43873db-bdea-4aa6-8967-d21bf877a87d tempest-ProjectReaderTests-1423655718 None] Lock "cinder-4bb4d190-c07d-4313-8994-1e6aecc508e8-delete_snapshot" released by "delete_snapshot" :: held 1.815s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:56 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.4457144c-9a05-4c04-9b1d-85583ca31242 Sep 04 16:10:56 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d4256fae-aa82-4a93-a477-b01c2ccc3ad9 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-2ee39dc1-8207-444c-bb0a-6cdbfed1c087-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d4256fae-aa82-4a93-a477-b01c2ccc3ad9 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-2ee39dc1-8207-444c-bb0a-6cdbfed1c087-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:56 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.4457144c-9a05-4c04-9b1d-85583ca31242" returned: 0 in 0.457s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4713a680-7917-44f9-a89b-4b754016a788(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:10:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d4256fae-aa82-4a93-a477-b01c2ccc3ad9 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-quobyte-2ee39dc1-8207-444c-bb0a-6cdbfed1c087" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:56 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a33bd6b-e186-4243-a1db-fcfb80e746ba]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:56 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d4256fae-aa82-4a93-a477-b01c2ccc3ad9 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-2ee39dc1-8207-444c-bb0a-6cdbfed1c087" acquired by "delete_volume" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:56 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da22dc7-237c-4a71-899c-eaf052ef0c8d]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d4256fae-aa82-4a93-a477-b01c2ccc3ad9 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:56 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788 Sep 04 16:10:56 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:56 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087 Sep 04 16:10:56 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:56 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788" returned: 0 in 0.403s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.4457144c-9a05-4c04-9b1d-85583ca31242 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:56 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.4457144c-9a05-4c04-9b1d-85583ca31242 Sep 04 16:10:56 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:57 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d4256fae-aa82-4a93-a477-b01c2ccc3ad9 tempest-ProjectReaderTests-1423655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087" returned: 0 in 0.423s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d4256fae-aa82-4a93-a477-b01c2ccc3ad9 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:57 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087 Sep 04 16:10:57 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:57 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d4256fae-aa82-4a93-a477-b01c2ccc3ad9 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-2ee39dc1-8207-444c-bb0a-6cdbfed1c087" returned: 0 in 0.268s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:57 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d4256fae-aa82-4a93-a477-b01c2ccc3ad9 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-2ee39dc1-8207-444c-bb0a-6cdbfed1c087" released by "delete_volume" :: held 0.775s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.4457144c-9a05-4c04-9b1d-85583ca31242" returned: 0 in 0.389s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.4457144c-9a05-4c04-9b1d-85583ca31242 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:57 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.4457144c-9a05-4c04-9b1d-85583ca31242 Sep 04 16:10:57 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:57 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-d4256fae-aa82-4a93-a477-b01c2ccc3ad9 tempest-ProjectReaderTests-1423655718 None] Created reservations ['7526c768-0652-4098-b7a5-634de18a6110', '781da68c-60b0-4969-a4c6-656bc5e10379', '86f0d71a-a319-4693-b54c-d78c9806c89c', '7f74346e-7f23-4fcb-96ea-1095b544dc77'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d4256fae-aa82-4a93-a477-b01c2ccc3ad9 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d4256fae-aa82-4a93-a477-b01c2ccc3ad9 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d4256fae-aa82-4a93-a477-b01c2ccc3ad9 tempest-ProjectReaderTests-1423655718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-d4256fae-aa82-4a93-a477-b01c2ccc3ad9 tempest-ProjectReaderTests-1423655718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-d4256fae-aa82-4a93-a477-b01c2ccc3ad9 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d4256fae-aa82-4a93-a477-b01c2ccc3ad9 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:57 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:10:57 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:57 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788.4457144c-9a05-4c04-9b1d-85583ca31242" returned: 0 in 0.303s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-4457144c-9a05-4c04-9b1d-85583ca31242" released by "_delete_snapshot" :: held 1.719s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-4713a680-7917-44f9-a89b-4b754016a788" released by "delete_snapshot" :: held 1.760s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:57 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-d4256fae-aa82-4a93-a477-b01c2ccc3ad9 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.331s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:57 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-d4256fae-aa82-4a93-a477-b01c2ccc3ad9 tempest-ProjectReaderTests-1423655718 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:10:57 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] Created reservations ['0b153540-e1ee-4cfe-8046-72e17122c8f5', 'd0ae9cae-d8de-4da5-841b-dd8fe29137ae', '161ecc76-2799-4743-a990-61bcf77677bf', '58f2fe09-50d4-458b-bcf8-27c793b3844b'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:57 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-d4256fae-aa82-4a93-a477-b01c2ccc3ad9 tempest-ProjectReaderTests-1423655718 None] Deleted volume successfully. Sep 04 16:10:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-d4256fae-aa82-4a93-a477-b01c2ccc3ad9 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-2ee39dc1-8207-444c-bb0a-6cdbfed1c087-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:57 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] Delete snapshot completed successfully. Sep 04 16:10:57 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-bbe41423-3ef8-4dde-8803-58fd464ac524 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-4457144c-9a05-4c04-9b1d-85583ca31242-delete_snapshot" released by "delete_snapshot" :: held 1.978s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-03e311b8-c66a-44cd-92fc-389395d04d15 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-4713a680-7917-44f9-a89b-4b754016a788-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Flow 'volume_create_manager' (7495ab9f-410b-4659-8c17-d885807ae995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d474311-5d42-41b2-b438-2b4b1cda1c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d474311-5d42-41b2-b438-2b4b1cda1c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-494220087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762f3bd9-40bb-4154-977a-bd7a8d21825e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e4d51b820b44b4a7a5be87ff0020bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:58Z,use_quota=True,user_id='1903be57da7842f78985ac122b895e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba90eb5-e6e3-4b91-9bd7-4aeb1de0fa32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba90eb5-e6e3-4b91-9bd7-4aeb1de0fa32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f35810-c65b-4b50-a992-51ce198f7682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f35810-c65b-4b50-a992-51ce198f7682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '762f3bd9-40bb-4154-977a-bd7a8d21825e', 'volume_name': 'volume-762f3bd9-40bb-4154-977a-bd7a8d21825e', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65fa13c-fd8c-42a0-aefa-b167c63688af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65fa13c-fd8c-42a0-aefa-b167c63688af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ee788b-296f-45fa-88ec-79bfb8a1d6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:58 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Volume 762f3bd9-40bb-4154-977a-bd7a8d21825e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-762f3bd9-40bb-4154-977a-bd7a8d21825e', 'volume_size': 1} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-494220087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762f3bd9-40bb-4154-977a-bd7a8d21825e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e4d51b820b44b4a7a5be87ff0020bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:10:58Z,use_quota=True,user_id='1903be57da7842f78985ac122b895e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Creating volume 762f3bd9-40bb-4154-977a-bd7a8d21825e {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:10:58 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-03e311b8-c66a-44cd-92fc-389395d04d15 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-4713a680-7917-44f9-a89b-4b754016a788-delete_volume" acquired by "delete_volume" :: waited 0.136s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:58 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e 1073741824 Sep 04 16:10:58 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-03e311b8-c66a-44cd-92fc-389395d04d15 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-4713a680-7917-44f9-a89b-4b754016a788" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-03e311b8-c66a-44cd-92fc-389395d04d15 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-4713a680-7917-44f9-a89b-4b754016a788" acquired by "delete_volume" :: waited 0.029s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[960892ca-0dc5-49e7-9258-3a9810ada0ac]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-03e311b8-c66a-44cd-92fc-389395d04d15 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:58 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788 Sep 04 16:10:58 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:58 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e 1073741824" returned: 0 in 0.491s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:58 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e Sep 04 16:10:58 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:58 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-03e311b8-c66a-44cd-92fc-389395d04d15 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788" returned: 0 in 0.449s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-03e311b8-c66a-44cd-92fc-389395d04d15 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:58 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788 Sep 04 16:10:58 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:59 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e" returned: 0 in 0.263s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:10:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ee788b-296f-45fa-88ec-79bfb8a1d6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-762f3bd9-40bb-4154-977a-bd7a8d21825e', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e324ea39-8af1-48b0-9e4f-7deca3dda1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:10:59 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Volume volume-762f3bd9-40bb-4154-977a-bd7a8d21825e (762f3bd9-40bb-4154-977a-bd7a8d21825e): created successfully Sep 04 16:10:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e324ea39-8af1-48b0-9e4f-7deca3dda1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:10:59 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Flow 'volume_create_manager' (7495ab9f-410b-4659-8c17-d885807ae995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:10:59 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-66e5daaf-755b-4231-8c97-5a951ac6cad5 tempest-ProjectReaderTests-1423655718 None] Created volume successfully. Sep 04 16:10:59 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-03e311b8-c66a-44cd-92fc-389395d04d15 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-4713a680-7917-44f9-a89b-4b754016a788" returned: 0 in 0.277s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-03e311b8-c66a-44cd-92fc-389395d04d15 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-4713a680-7917-44f9-a89b-4b754016a788" released by "delete_volume" :: held 0.803s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:10:59 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-03e311b8-c66a-44cd-92fc-389395d04d15 tempest-ProjectMemberTests-2060754872 None] Created reservations ['3126020f-1028-4cf9-9edd-1d870500b59d', 'f9a19219-4d92-43bc-95e4-6862ac21557d', 'e3bc6392-c9a8-4392-aefd-d3b44c81493f', '06ce88c2-ad21-45ac-9d27-d762a666c18d'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:10:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-03e311b8-c66a-44cd-92fc-389395d04d15 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:10:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-03e311b8-c66a-44cd-92fc-389395d04d15 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:10:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-03e311b8-c66a-44cd-92fc-389395d04d15 tempest-ProjectMemberTests-2060754872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:10:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-03e311b8-c66a-44cd-92fc-389395d04d15 tempest-ProjectMemberTests-2060754872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:10:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-03e311b8-c66a-44cd-92fc-389395d04d15 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:10:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-03e311b8-c66a-44cd-92fc-389395d04d15 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:10:59 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:10:59 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:10:59 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Sep 04 16:10:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-03e311b8-c66a-44cd-92fc-389395d04d15 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.330s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:10:59 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-03e311b8-c66a-44cd-92fc-389395d04d15 tempest-ProjectMemberTests-2060754872 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:10:59 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-03e311b8-c66a-44cd-92fc-389395d04d15 tempest-ProjectMemberTests-2060754872 None] Deleted volume successfully. Sep 04 16:10:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-03e311b8-c66a-44cd-92fc-389395d04d15 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-4713a680-7917-44f9-a89b-4b754016a788-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fae631ea-5732-4505-81b6-6212468f6b0e tempest-ProjectReaderTests-1423655718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fae631ea-5732-4505-81b6-6212468f6b0e tempest-ProjectReaderTests-1423655718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:00 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-fae631ea-5732-4505-81b6-6212468f6b0e tempest-ProjectReaderTests-1423655718 None] Creating offline snapshot 0e2328f3-f424-4c9a-9014-b9abe29a168b of volume 762f3bd9-40bb-4154-977a-bd7a8d21825e {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:11:00 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02c508e-1a3d-4330-8555-251ebc7cc218]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fae631ea-5732-4505-81b6-6212468f6b0e tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:00 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e Sep 04 16:11:00 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:00 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fae631ea-5732-4505-81b6-6212468f6b0e tempest-ProjectReaderTests-1423655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e" returned: 0 in 0.459s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fae631ea-5732-4505-81b6-6212468f6b0e tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.0e2328f3-f424-4c9a-9014-b9abe29a168b 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:00 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.0e2328f3-f424-4c9a-9014-b9abe29a168b 1G Sep 04 16:11:00 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:01 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:11:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Flow 'volume_create_manager' (0e0e78c7-68ba-4c75-9618-bef706e5e3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b3abc5-1ffd-478a-ba9f-fc49aced1983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b3abc5-1ffd-478a-ba9f-fc49aced1983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10841442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87741d6e-a752-4395-9fa1-53df128be7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb01159052a40b287cf32491b8d265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:01Z,use_quota=True,user_id='bac5509d617040ee9cc4a5e5f8232b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8f4255-f777-4ce7-9be1-17aa3e8daaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8f4255-f777-4ce7-9be1-17aa3e8daaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f334e946-750a-44b9-8846-1051f48985d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f334e946-750a-44b9-8846-1051f48985d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87741d6e-a752-4395-9fa1-53df128be7c7', 'volume_name': 'volume-87741d6e-a752-4395-9fa1-53df128be7c7', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf5314b-883a-4a81-a7bc-da2c16042302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf5314b-883a-4a81-a7bc-da2c16042302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:01 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ab3a34-2412-4199-9ce8-7aa0cf9a2274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:01 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Volume 87741d6e-a752-4395-9fa1-53df128be7c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87741d6e-a752-4395-9fa1-53df128be7c7', 'volume_size': 1} Sep 04 16:11:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:01 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fae631ea-5732-4505-81b6-6212468f6b0e tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.0e2328f3-f424-4c9a-9014-b9abe29a168b 1G" returned: 0 in 0.431s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fae631ea-5732-4505-81b6-6212468f6b0e tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-762f3bd9-40bb-4154-977a-bd7a8d21825e -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.0e2328f3-f424-4c9a-9014-b9abe29a168b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:01 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-762f3bd9-40bb-4154-977a-bd7a8d21825e -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.0e2328f3-f424-4c9a-9014-b9abe29a168b Sep 04 16:11:01 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:01 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fae631ea-5732-4505-81b6-6212468f6b0e tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-762f3bd9-40bb-4154-977a-bd7a8d21825e -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.0e2328f3-f424-4c9a-9014-b9abe29a168b" returned: 0 in 0.319s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:01 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-fae631ea-5732-4505-81b6-6212468f6b0e tempest-ProjectReaderTests-1423655718 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.0e2328f3-f424-4c9a-9014-b9abe29a168b is being set with open permissions: ugo+rw Sep 04 16:11:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fae631ea-5732-4505-81b6-6212468f6b0e tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.0e2328f3-f424-4c9a-9014-b9abe29a168b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:01 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.0e2328f3-f424-4c9a-9014-b9abe29a168b Sep 04 16:11:01 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:01 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fae631ea-5732-4505-81b6-6212468f6b0e tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.0e2328f3-f424-4c9a-9014-b9abe29a168b" returned: 0 in 0.256s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fae631ea-5732-4505-81b6-6212468f6b0e tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:02 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.info Sep 04 16:11:02 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:02 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fae631ea-5732-4505-81b6-6212468f6b0e tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.info" returned: 0 in 0.274s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:02 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-fae631ea-5732-4505-81b6-6212468f6b0e tempest-ProjectReaderTests-1423655718 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.info is being set with open permissions: ugo+rw Sep 04 16:11:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fae631ea-5732-4505-81b6-6212468f6b0e tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:02 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.info Sep 04 16:11:02 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:02 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fae631ea-5732-4505-81b6-6212468f6b0e tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.info" returned: 0 in 0.255s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fae631ea-5732-4505-81b6-6212468f6b0e tempest-ProjectReaderTests-1423655718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.093s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.385s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10841442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87741d6e-a752-4395-9fa1-53df128be7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb01159052a40b287cf32491b8d265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:01Z,use_quota=True,user_id='bac5509d617040ee9cc4a5e5f8232b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:11:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Creating volume 87741d6e-a752-4395-9fa1-53df128be7c7 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:11:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:11:02 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:11:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:02 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7 1073741824 Sep 04 16:11:02 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:02 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-fae631ea-5732-4505-81b6-6212468f6b0e tempest-ProjectReaderTests-1423655718 None] Create snapshot completed successfully Sep 04 16:11:03 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7 1073741824" returned: 0 in 0.471s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:03 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7 Sep 04 16:11:03 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:03 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7" returned: 0 in 0.290s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:11:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ab3a34-2412-4199-9ce8-7aa0cf9a2274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87741d6e-a752-4395-9fa1-53df128be7c7', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d86c0d-9ddf-49a6-98c3-a02d318c57c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:03 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Volume volume-87741d6e-a752-4395-9fa1-53df128be7c7 (87741d6e-a752-4395-9fa1-53df128be7c7): created successfully Sep 04 16:11:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d86c0d-9ddf-49a6-98c3-a02d318c57c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:03 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Flow 'volume_create_manager' (0e0e78c7-68ba-4c75-9618-bef706e5e3c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:03 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-c99461b2-05a6-4ba9-af32-a53e12a5e020 tempest-ProjectMemberTests-2060754872 None] Created volume successfully. Sep 04 16:11:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-0e2328f3-f424-4c9a-9014-b9abe29a168b-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] Lock "cinder-0e2328f3-f424-4c9a-9014-b9abe29a168b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-quobyte-762f3bd9-40bb-4154-977a-bd7a8d21825e" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-762f3bd9-40bb-4154-977a-bd7a8d21825e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-quobyte-0e2328f3-f424-4c9a-9014-b9abe29a168b" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:03 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-0e2328f3-f424-4c9a-9014-b9abe29a168b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] Deleting offline snapshot 0e2328f3-f424-4c9a-9014-b9abe29a168b of volume 762f3bd9-40bb-4154-977a-bd7a8d21825e {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:11:03 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] snapshot_file for this snap is: volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.0e2328f3-f424-4c9a-9014-b9abe29a168b {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:11:03 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[5371903a-1540-41a0-ab41-20ccf47b4946]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:03 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.0e2328f3-f424-4c9a-9014-b9abe29a168b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:03 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.0e2328f3-f424-4c9a-9014-b9abe29a168b Sep 04 16:11:03 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:04 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.0e2328f3-f424-4c9a-9014-b9abe29a168b" returned: 0 in 0.398s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-762f3bd9-40bb-4154-977a-bd7a8d21825e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:11:04 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6976d49f-42ee-4e1e-9ffa-35f0f99c70b2]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:04 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e Sep 04 16:11:04 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dcc92ca2-2e82-4236-b309-09118b1b9cab tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dcc92ca2-2e82-4236-b309-09118b1b9cab tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:04 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-dcc92ca2-2e82-4236-b309-09118b1b9cab tempest-ProjectMemberTests-2060754872 None] Creating offline snapshot 5ab4b699-b688-4624-bfa6-e95ebc58feaa of volume 87741d6e-a752-4395-9fa1-53df128be7c7 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:11:04 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ee970f-1e35-49b9-a6ce-f1805bd34831]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dcc92ca2-2e82-4236-b309-09118b1b9cab tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:04 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e" returned: 0 in 0.434s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.0e2328f3-f424-4c9a-9014-b9abe29a168b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:04 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.0e2328f3-f424-4c9a-9014-b9abe29a168b Sep 04 16:11:04 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:04 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7 Sep 04 16:11:04 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:04 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dcc92ca2-2e82-4236-b309-09118b1b9cab tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7" returned: 0 in 0.375s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dcc92ca2-2e82-4236-b309-09118b1b9cab tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.5ab4b699-b688-4624-bfa6-e95ebc58feaa 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:04 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.5ab4b699-b688-4624-bfa6-e95ebc58feaa 1G Sep 04 16:11:04 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:04 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.0e2328f3-f424-4c9a-9014-b9abe29a168b" returned: 0 in 0.374s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:04 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.0e2328f3-f424-4c9a-9014-b9abe29a168b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:04 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.0e2328f3-f424-4c9a-9014-b9abe29a168b Sep 04 16:11:04 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:05 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e.0e2328f3-f424-4c9a-9014-b9abe29a168b" returned: 0 in 0.298s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-0e2328f3-f424-4c9a-9014-b9abe29a168b" released by "_delete_snapshot" :: held 1.624s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-762f3bd9-40bb-4154-977a-bd7a8d21825e" released by "delete_snapshot" :: held 1.654s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:05 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dcc92ca2-2e82-4236-b309-09118b1b9cab tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.5ab4b699-b688-4624-bfa6-e95ebc58feaa 1G" returned: 0 in 0.429s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dcc92ca2-2e82-4236-b309-09118b1b9cab tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87741d6e-a752-4395-9fa1-53df128be7c7 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.5ab4b699-b688-4624-bfa6-e95ebc58feaa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:05 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87741d6e-a752-4395-9fa1-53df128be7c7 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.5ab4b699-b688-4624-bfa6-e95ebc58feaa Sep 04 16:11:05 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:05 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] Created reservations ['f37d2f0e-d80d-44d6-97b2-abba536b2bcb', 'a1524788-3a87-4b00-a82c-011dc9ecba8a', '40988870-0f91-41a8-9e53-5c517ba9843a', '223b2ce5-5fea-4aa1-b68b-a56554d43577'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:11:05 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] Delete snapshot completed successfully. Sep 04 16:11:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e9ecb68e-ef34-460e-bee0-a096cda74b9d tempest-ProjectReaderTests-1423655718 None] Lock "cinder-0e2328f3-f424-4c9a-9014-b9abe29a168b-delete_snapshot" released by "delete_snapshot" :: held 1.855s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:05 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dcc92ca2-2e82-4236-b309-09118b1b9cab tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87741d6e-a752-4395-9fa1-53df128be7c7 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.5ab4b699-b688-4624-bfa6-e95ebc58feaa" returned: 0 in 0.326s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:05 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-dcc92ca2-2e82-4236-b309-09118b1b9cab tempest-ProjectMemberTests-2060754872 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.5ab4b699-b688-4624-bfa6-e95ebc58feaa is being set with open permissions: ugo+rw Sep 04 16:11:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dcc92ca2-2e82-4236-b309-09118b1b9cab tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.5ab4b699-b688-4624-bfa6-e95ebc58feaa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:05 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.5ab4b699-b688-4624-bfa6-e95ebc58feaa Sep 04 16:11:05 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-72ed5638-3c83-458d-8b6c-bc66e7909229 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-762f3bd9-40bb-4154-977a-bd7a8d21825e-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-72ed5638-3c83-458d-8b6c-bc66e7909229 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-762f3bd9-40bb-4154-977a-bd7a8d21825e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-72ed5638-3c83-458d-8b6c-bc66e7909229 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-quobyte-762f3bd9-40bb-4154-977a-bd7a8d21825e" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:05 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-72ed5638-3c83-458d-8b6c-bc66e7909229 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-762f3bd9-40bb-4154-977a-bd7a8d21825e" acquired by "delete_volume" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:05 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e1f6b4-8da3-4930-a660-00cfb0a6b710]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:05 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-72ed5638-3c83-458d-8b6c-bc66e7909229 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:06 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dcc92ca2-2e82-4236-b309-09118b1b9cab tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.5ab4b699-b688-4624-bfa6-e95ebc58feaa" returned: 0 in 0.385s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dcc92ca2-2e82-4236-b309-09118b1b9cab tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:06 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.info Sep 04 16:11:06 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:06 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e Sep 04 16:11:06 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:06 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dcc92ca2-2e82-4236-b309-09118b1b9cab tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.info" returned: 0 in 0.320s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:06 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-dcc92ca2-2e82-4236-b309-09118b1b9cab tempest-ProjectMemberTests-2060754872 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.info is being set with open permissions: ugo+rw Sep 04 16:11:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dcc92ca2-2e82-4236-b309-09118b1b9cab tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:06 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-72ed5638-3c83-458d-8b6c-bc66e7909229 tempest-ProjectReaderTests-1423655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e" returned: 0 in 0.428s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-72ed5638-3c83-458d-8b6c-bc66e7909229 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:06 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.info Sep 04 16:11:06 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:06 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e Sep 04 16:11:06 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:06 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-72ed5638-3c83-458d-8b6c-bc66e7909229 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-762f3bd9-40bb-4154-977a-bd7a8d21825e" returned: 0 in 0.277s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:06 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-72ed5638-3c83-458d-8b6c-bc66e7909229 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-762f3bd9-40bb-4154-977a-bd7a8d21825e" released by "delete_volume" :: held 0.802s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:06 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-dcc92ca2-2e82-4236-b309-09118b1b9cab tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.info" returned: 0 in 0.337s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-dcc92ca2-2e82-4236-b309-09118b1b9cab tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.284s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:06 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-dcc92ca2-2e82-4236-b309-09118b1b9cab tempest-ProjectMemberTests-2060754872 None] Create snapshot completed successfully Sep 04 16:11:06 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-72ed5638-3c83-458d-8b6c-bc66e7909229 tempest-ProjectReaderTests-1423655718 None] Created reservations ['85905a20-ac12-4437-a953-83c8abbc063a', '0b6590fd-67f3-4d5f-9ae6-25de67a8d7df', 'f2345fae-ec49-4c7e-ac7f-05123a1aae69', '1faad321-7b11-4ea3-b795-f03866312685'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:11:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-72ed5638-3c83-458d-8b6c-bc66e7909229 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-72ed5638-3c83-458d-8b6c-bc66e7909229 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:06 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-72ed5638-3c83-458d-8b6c-bc66e7909229 tempest-ProjectReaderTests-1423655718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:06 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-72ed5638-3c83-458d-8b6c-bc66e7909229 tempest-ProjectReaderTests-1423655718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-72ed5638-3c83-458d-8b6c-bc66e7909229 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:06 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-72ed5638-3c83-458d-8b6c-bc66e7909229 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:06 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:11:06 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:07 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-72ed5638-3c83-458d-8b6c-bc66e7909229 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.292s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-72ed5638-3c83-458d-8b6c-bc66e7909229 tempest-ProjectReaderTests-1423655718 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:11:07 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-72ed5638-3c83-458d-8b6c-bc66e7909229 tempest-ProjectReaderTests-1423655718 None] Deleted volume successfully. Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-72ed5638-3c83-458d-8b6c-bc66e7909229 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-762f3bd9-40bb-4154-977a-bd7a8d21825e-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Flow 'volume_create_manager' (22554740-d72a-49c0-9a1e-1b4020f55b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9dc034a-eae3-4a93-8037-3b5ebd6618a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9dc034a-eae3-4a93-8037-3b5ebd6618a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2029579030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0caae540-2f8a-45e8-96b4-7a1b80e90c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e4d51b820b44b4a7a5be87ff0020bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:07Z,use_quota=True,user_id='1903be57da7842f78985ac122b895e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7391b1ea-c505-48e9-beb0-b63a7aeb1639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7391b1ea-c505-48e9-beb0-b63a7aeb1639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe46f34d-7046-49b7-aff6-1a77bdb46a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe46f34d-7046-49b7-aff6-1a77bdb46a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0caae540-2f8a-45e8-96b4-7a1b80e90c9f', 'volume_name': 'volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22aa7b75-ced1-4704-8bf8-d60c318616f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22aa7b75-ced1-4704-8bf8-d60c318616f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849388fe-bcef-497f-af55-c09c3e48ec59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:07 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Volume 0caae540-2f8a-45e8-96b4-7a1b80e90c9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f', 'volume_size': 1} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2029579030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0caae540-2f8a-45e8-96b4-7a1b80e90c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e4d51b820b44b4a7a5be87ff0020bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:07Z,use_quota=True,user_id='1903be57da7842f78985ac122b895e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Creating volume 0caae540-2f8a-45e8-96b4-7a1b80e90c9f {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:11:07 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:07 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f 1073741824 Sep 04 16:11:07 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-5ab4b699-b688-4624-bfa6-e95ebc58feaa-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-5ab4b699-b688-4624-bfa6-e95ebc58feaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-87741d6e-a752-4395-9fa1-53df128be7c7" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-87741d6e-a752-4395-9fa1-53df128be7c7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-5ab4b699-b688-4624-bfa6-e95ebc58feaa" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-5ab4b699-b688-4624-bfa6-e95ebc58feaa" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] Deleting offline snapshot 5ab4b699-b688-4624-bfa6-e95ebc58feaa of volume 87741d6e-a752-4395-9fa1-53df128be7c7 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] snapshot_file for this snap is: volume-87741d6e-a752-4395-9fa1-53df128be7c7.5ab4b699-b688-4624-bfa6-e95ebc58feaa {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca1f76f-69a7-48f2-b0c3-418601324b0d]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:07 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.5ab4b699-b688-4624-bfa6-e95ebc58feaa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:07 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.5ab4b699-b688-4624-bfa6-e95ebc58feaa Sep 04 16:11:07 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:08 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f 1073741824" returned: 0 in 0.626s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:08 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.5ab4b699-b688-4624-bfa6-e95ebc58feaa" returned: 0 in 0.473s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87741d6e-a752-4395-9fa1-53df128be7c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:11:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:08 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef27367b-b0da-4eb6-a797-72b58b489f74]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:08 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f Sep 04 16:11:08 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:08 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7 Sep 04 16:11:08 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:08 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f" returned: 0 in 0.297s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:08 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:11:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849388fe-bcef-497f-af55-c09c3e48ec59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98b162b-8f1f-4714-a69c-b1ce17662879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:08 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Volume volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f (0caae540-2f8a-45e8-96b4-7a1b80e90c9f): created successfully Sep 04 16:11:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98b162b-8f1f-4714-a69c-b1ce17662879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:08 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Flow 'volume_create_manager' (22554740-d72a-49c0-9a1e-1b4020f55b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:08 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-2210774e-802a-448a-8f5a-b33875645cfe tempest-ProjectReaderTests-1423655718 None] Created volume successfully. Sep 04 16:11:08 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7" returned: 0 in 0.459s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:08 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.5ab4b699-b688-4624-bfa6-e95ebc58feaa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:08 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.5ab4b699-b688-4624-bfa6-e95ebc58feaa Sep 04 16:11:08 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:09 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.5ab4b699-b688-4624-bfa6-e95ebc58feaa" returned: 0 in 0.367s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.5ab4b699-b688-4624-bfa6-e95ebc58feaa {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:09 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.5ab4b699-b688-4624-bfa6-e95ebc58feaa Sep 04 16:11:09 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:09 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7.5ab4b699-b688-4624-bfa6-e95ebc58feaa" returned: 0 in 0.262s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-5ab4b699-b688-4624-bfa6-e95ebc58feaa" released by "_delete_snapshot" :: held 1.688s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-87741d6e-a752-4395-9fa1-53df128be7c7" released by "delete_snapshot" :: held 1.722s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:09 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] Created reservations ['67509f42-e7bd-499d-ad9a-1e5110ba7970', '7f99d3c8-99f0-48ae-af69-c1951c509e96', 'a7997e80-fa54-4b75-b1f4-9a903b542945', 'da0cc2da-b94c-4625-9f46-56131d833183'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:11:09 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] Delete snapshot completed successfully. Sep 04 16:11:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c4bc0cad-6ea6-4127-b960-b8496e750842 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-5ab4b699-b688-4624-bfa6-e95ebc58feaa-delete_snapshot" released by "delete_snapshot" :: held 1.906s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-24dd30e3-42a0-460e-b311-bd299cad8c3d tempest-ProjectReaderTests-1423655718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-24dd30e3-42a0-460e-b311-bd299cad8c3d tempest-ProjectReaderTests-1423655718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:09 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-24dd30e3-42a0-460e-b311-bd299cad8c3d tempest-ProjectReaderTests-1423655718 None] Creating offline snapshot bf19a489-606a-4605-88db-f8afdcfc156c of volume 0caae540-2f8a-45e8-96b4-7a1b80e90c9f {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:11:09 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3732c5e0-b6c6-4913-b6fa-f36c5f07d272]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:09 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-24dd30e3-42a0-460e-b311-bd299cad8c3d tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1dd26ee5-657c-4999-80bc-27f64ec05d45 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-87741d6e-a752-4395-9fa1-53df128be7c7-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:09 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1dd26ee5-657c-4999-80bc-27f64ec05d45 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-87741d6e-a752-4395-9fa1-53df128be7c7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:10 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1dd26ee5-657c-4999-80bc-27f64ec05d45 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-87741d6e-a752-4395-9fa1-53df128be7c7" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:10 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1dd26ee5-657c-4999-80bc-27f64ec05d45 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-87741d6e-a752-4395-9fa1-53df128be7c7" acquired by "delete_volume" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:10 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f Sep 04 16:11:10 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:10 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9953c8-0bd0-4d8d-99d7-a7b987eee2a9]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1dd26ee5-657c-4999-80bc-27f64ec05d45 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:10 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7 Sep 04 16:11:10 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:10 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-24dd30e3-42a0-460e-b311-bd299cad8c3d tempest-ProjectReaderTests-1423655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f" returned: 0 in 0.429s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-24dd30e3-42a0-460e-b311-bd299cad8c3d tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.bf19a489-606a-4605-88db-f8afdcfc156c 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:10 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.bf19a489-606a-4605-88db-f8afdcfc156c 1G Sep 04 16:11:10 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:10 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1dd26ee5-657c-4999-80bc-27f64ec05d45 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7" returned: 0 in 0.453s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1dd26ee5-657c-4999-80bc-27f64ec05d45 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:10 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7 Sep 04 16:11:10 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:10 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1dd26ee5-657c-4999-80bc-27f64ec05d45 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-87741d6e-a752-4395-9fa1-53df128be7c7" returned: 0 in 0.311s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:10 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1dd26ee5-657c-4999-80bc-27f64ec05d45 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-87741d6e-a752-4395-9fa1-53df128be7c7" released by "delete_volume" :: held 0.838s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:10 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-1dd26ee5-657c-4999-80bc-27f64ec05d45 tempest-ProjectMemberTests-2060754872 None] Created reservations ['3eb9b66c-9820-4ba5-95e8-4d52969923cb', 'd697d1bd-fe4d-4d0b-adcb-d9717b435613', 'd4d3c0ee-db10-4ad1-a6fa-daa45b6323f1', '7caa6ac7-2b32-484c-86b2-69c5f44b2ff8'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:11:10 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-24dd30e3-42a0-460e-b311-bd299cad8c3d tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.bf19a489-606a-4605-88db-f8afdcfc156c 1G" returned: 0 in 0.610s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:10 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-24dd30e3-42a0-460e-b311-bd299cad8c3d tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.bf19a489-606a-4605-88db-f8afdcfc156c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:10 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.bf19a489-606a-4605-88db-f8afdcfc156c Sep 04 16:11:10 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1dd26ee5-657c-4999-80bc-27f64ec05d45 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1dd26ee5-657c-4999-80bc-27f64ec05d45 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1dd26ee5-657c-4999-80bc-27f64ec05d45 tempest-ProjectMemberTests-2060754872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-1dd26ee5-657c-4999-80bc-27f64ec05d45 tempest-ProjectMemberTests-2060754872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-1dd26ee5-657c-4999-80bc-27f64ec05d45 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1dd26ee5-657c-4999-80bc-27f64ec05d45 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:11 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:11:11 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:11 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-1dd26ee5-657c-4999-80bc-27f64ec05d45 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.370s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-1dd26ee5-657c-4999-80bc-27f64ec05d45 tempest-ProjectMemberTests-2060754872 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:11:11 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-1dd26ee5-657c-4999-80bc-27f64ec05d45 tempest-ProjectMemberTests-2060754872 None] Deleted volume successfully. Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-1dd26ee5-657c-4999-80bc-27f64ec05d45 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-87741d6e-a752-4395-9fa1-53df128be7c7-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:11 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-24dd30e3-42a0-460e-b311-bd299cad8c3d tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.bf19a489-606a-4605-88db-f8afdcfc156c" returned: 0 in 0.584s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:11 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-24dd30e3-42a0-460e-b311-bd299cad8c3d tempest-ProjectReaderTests-1423655718 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.bf19a489-606a-4605-88db-f8afdcfc156c is being set with open permissions: ugo+rw Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-24dd30e3-42a0-460e-b311-bd299cad8c3d tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.bf19a489-606a-4605-88db-f8afdcfc156c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:11 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.bf19a489-606a-4605-88db-f8afdcfc156c Sep 04 16:11:11 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Flow 'volume_create_manager' (27d9ee8b-c002-4533-a799-9e22f88622fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db668ab7-3b74-47e9-92e7-1592a62ee976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db668ab7-3b74-47e9-92e7-1592a62ee976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1480182853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b263b689-6ce0-49f6-8d68-f4f57873ed51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb01159052a40b287cf32491b8d265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:12Z,use_quota=True,user_id='bac5509d617040ee9cc4a5e5f8232b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5017e23b-f4ec-45be-b610-7eecb41e8f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5017e23b-f4ec-45be-b610-7eecb41e8f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b61140-c39e-4e7d-90a7-df20f252d7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b61140-c39e-4e7d-90a7-df20f252d7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b263b689-6ce0-49f6-8d68-f4f57873ed51', 'volume_name': 'volume-b263b689-6ce0-49f6-8d68-f4f57873ed51', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:11 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbdd95a2-9083-4703-a072-317d22ac03cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbdd95a2-9083-4703-a072-317d22ac03cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf43c2c-8b70-4990-ae56-2f030651e111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:11 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Volume b263b689-6ce0-49f6-8d68-f4f57873ed51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b263b689-6ce0-49f6-8d68-f4f57873ed51', 'volume_size': 1} Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-24dd30e3-42a0-460e-b311-bd299cad8c3d tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.bf19a489-606a-4605-88db-f8afdcfc156c" returned: 0 in 0.301s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:11 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-24dd30e3-42a0-460e-b311-bd299cad8c3d tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:11 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.info Sep 04 16:11:11 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:12 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-24dd30e3-42a0-460e-b311-bd299cad8c3d tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.info" returned: 0 in 0.274s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:12 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-24dd30e3-42a0-460e-b311-bd299cad8c3d tempest-ProjectReaderTests-1423655718 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.info is being set with open permissions: ugo+rw Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-24dd30e3-42a0-460e-b311-bd299cad8c3d tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:11:12 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.info Sep 04 16:11:12 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Flow 'volume_create_manager' (f985789b-4820-459e-a91c-3fabc3b4da2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01221eca-68b7-4f1e-8d21-0a2202b1eafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01221eca-68b7-4f1e-8d21-0a2202b1eafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-746658104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc676c0-60a4-4b71-a8d4-ac7a720612ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb797440971409284baaa372acf8257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:12Z,use_quota=True,user_id='cd002834bc604e4c88a6d1adf1896638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6e499d-d65a-403d-a52f-44ac67afa2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6e499d-d65a-403d-a52f-44ac67afa2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e155a12-e9e9-4879-a0c6-5c03e71942a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e155a12-e9e9-4879-a0c6-5c03e71942a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcc676c0-60a4-4b71-a8d4-ac7a720612ef', 'volume_name': 'volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad41f0c6-e5be-4e81-9126-f66233963dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad41f0c6-e5be-4e81-9126-f66233963dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b91e9d7-38ac-4c6c-bf51-08d0221198b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:12 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Volume bcc676c0-60a4-4b71-a8d4-ac7a720612ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef', 'volume_size': 1} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:12 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-24dd30e3-42a0-460e-b311-bd299cad8c3d tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.info" returned: 0 in 0.265s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-24dd30e3-42a0-460e-b311-bd299cad8c3d tempest-ProjectReaderTests-1423655718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.565s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1480182853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b263b689-6ce0-49f6-8d68-f4f57873ed51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb01159052a40b287cf32491b8d265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:12Z,use_quota=True,user_id='bac5509d617040ee9cc4a5e5f8232b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Creating volume b263b689-6ce0-49f6-8d68-f4f57873ed51 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:11:12 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:12 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51 1073741824 Sep 04 16:11:12 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:12 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-24dd30e3-42a0-460e-b311-bd299cad8c3d tempest-ProjectReaderTests-1423655718 None] Create snapshot completed successfully Sep 04 16:11:12 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51 1073741824" returned: 0 in 0.428s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:12 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:12 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51 Sep 04 16:11:12 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-bf19a489-606a-4605-88db-f8afdcfc156c-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] Lock "cinder-bf19a489-606a-4605-88db-f8afdcfc156c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-quobyte-0caae540-2f8a-45e8-96b4-7a1b80e90c9f" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-0caae540-2f8a-45e8-96b4-7a1b80e90c9f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-quobyte-bf19a489-606a-4605-88db-f8afdcfc156c" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-bf19a489-606a-4605-88db-f8afdcfc156c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] Deleting offline snapshot bf19a489-606a-4605-88db-f8afdcfc156c of volume 0caae540-2f8a-45e8-96b4-7a1b80e90c9f {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] snapshot_file for this snap is: volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.bf19a489-606a-4605-88db-f8afdcfc156c {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32f5f59-36de-47f3-8d49-329c3c0ea56c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.bf19a489-606a-4605-88db-f8afdcfc156c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:13 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51" returned: 0 in 0.237s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.916s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-746658104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc676c0-60a4-4b71-a8d4-ac7a720612ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb797440971409284baaa372acf8257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:12Z,use_quota=True,user_id='cd002834bc604e4c88a6d1adf1896638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Creating volume bcc676c0-60a4-4b71-a8d4-ac7a720612ef {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:11:13 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf43c2c-8b70-4990-ae56-2f030651e111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b263b689-6ce0-49f6-8d68-f4f57873ed51', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:13 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef 1073741824 Sep 04 16:11:13 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3cf35d-fa73-4349-ad33-aaa91b02d86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:13 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Volume volume-b263b689-6ce0-49f6-8d68-f4f57873ed51 (b263b689-6ce0-49f6-8d68-f4f57873ed51): created successfully Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3cf35d-fa73-4349-ad33-aaa91b02d86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Flow 'volume_create_manager' (27d9ee8b-c002-4533-a799-9e22f88622fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:13 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-98ea6d83-9a30-4882-8253-52add375a0c0 tempest-ProjectMemberTests-2060754872 None] Created volume successfully. Sep 04 16:11:13 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.bf19a489-606a-4605-88db-f8afdcfc156c Sep 04 16:11:13 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:13 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.bf19a489-606a-4605-88db-f8afdcfc156c" returned: 0 in 0.386s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be3614e-870a-4f71-8773-cd41eb827525]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:13 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef 1073741824" returned: 0 in 0.403s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:13 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef Sep 04 16:11:13 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:13 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f Sep 04 16:11:13 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:13 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef" returned: 0 in 0.256s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b91e9d7-38ac-4c6c-bf51-08d0221198b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139204f8-b68e-4ace-b071-7f3933cfd9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:13 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Volume volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef (bcc676c0-60a4-4b71-a8d4-ac7a720612ef): created successfully Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139204f8-b68e-4ace-b071-7f3933cfd9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Flow 'volume_create_manager' (f985789b-4820-459e-a91c-3fabc3b4da2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:13 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-035828ad-a743-426a-9cde-e9bebe159969 tempest-SnapshotDependencyTests-1511326164 None] Created volume successfully. Sep 04 16:11:13 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f" returned: 0 in 0.424s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:13 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.bf19a489-606a-4605-88db-f8afdcfc156c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:13 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.bf19a489-606a-4605-88db-f8afdcfc156c Sep 04 16:11:13 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5bd57a9a-a198-4576-9da0-2bff23b0364d tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5bd57a9a-a198-4576-9da0-2bff23b0364d tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:14 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-5bd57a9a-a198-4576-9da0-2bff23b0364d tempest-ProjectMemberTests-2060754872 None] Creating offline snapshot 0581b85f-f676-44b2-a12f-c832f8de6e5f of volume b263b689-6ce0-49f6-8d68-f4f57873ed51 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:11:14 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[61606dfc-a4e4-479b-b0cd-d5d1d20b5900]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5bd57a9a-a198-4576-9da0-2bff23b0364d tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:14 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51 Sep 04 16:11:14 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:14 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.bf19a489-606a-4605-88db-f8afdcfc156c" returned: 0 in 0.377s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.bf19a489-606a-4605-88db-f8afdcfc156c {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:14 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.bf19a489-606a-4605-88db-f8afdcfc156c Sep 04 16:11:14 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-610e2bb4-4072-4818-ac25-414b1756dcb5 tempest-SnapshotDependencyTests-1511326164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:14 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5bd57a9a-a198-4576-9da0-2bff23b0364d tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51" returned: 0 in 0.395s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5bd57a9a-a198-4576-9da0-2bff23b0364d tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.0581b85f-f676-44b2-a12f-c832f8de6e5f 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:14 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.0581b85f-f676-44b2-a12f-c832f8de6e5f 1G Sep 04 16:11:14 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:14 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f.bf19a489-606a-4605-88db-f8afdcfc156c" returned: 0 in 0.272s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-bf19a489-606a-4605-88db-f8afdcfc156c" released by "_delete_snapshot" :: held 1.544s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-0caae540-2f8a-45e8-96b4-7a1b80e90c9f" released by "delete_snapshot" :: held 1.570s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:14 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] Created reservations ['ffd74d5a-acd6-4280-81da-3f931c4cf2cb', '07669765-aa96-46b5-849d-ca0895e66bbe', 'c4ce5c51-1466-4c4d-a7ba-c8714cab2b31', '592a5d48-16aa-4199-90d1-91f0bb995214'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:11:14 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] Delete snapshot completed successfully. Sep 04 16:11:14 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6dda0689-df5a-4d07-a3b5-72295f02f7af tempest-ProjectReaderTests-1423655718 None] Lock "cinder-bf19a489-606a-4605-88db-f8afdcfc156c-delete_snapshot" released by "delete_snapshot" :: held 1.715s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:14 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5bd57a9a-a198-4576-9da0-2bff23b0364d tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.0581b85f-f676-44b2-a12f-c832f8de6e5f 1G" returned: 0 in 0.378s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:14 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5bd57a9a-a198-4576-9da0-2bff23b0364d tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b263b689-6ce0-49f6-8d68-f4f57873ed51 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.0581b85f-f676-44b2-a12f-c832f8de6e5f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:14 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b263b689-6ce0-49f6-8d68-f4f57873ed51 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.0581b85f-f676-44b2-a12f-c832f8de6e5f Sep 04 16:11:14 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:15 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3e426a20-78b7-4cec-ad8e-012452706d84 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-0caae540-2f8a-45e8-96b4-7a1b80e90c9f-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:15 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3e426a20-78b7-4cec-ad8e-012452706d84 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-0caae540-2f8a-45e8-96b4-7a1b80e90c9f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:15 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5bd57a9a-a198-4576-9da0-2bff23b0364d tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b263b689-6ce0-49f6-8d68-f4f57873ed51 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.0581b85f-f676-44b2-a12f-c832f8de6e5f" returned: 0 in 0.311s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:15 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-5bd57a9a-a198-4576-9da0-2bff23b0364d tempest-ProjectMemberTests-2060754872 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.0581b85f-f676-44b2-a12f-c832f8de6e5f is being set with open permissions: ugo+rw Sep 04 16:11:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5bd57a9a-a198-4576-9da0-2bff23b0364d tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.0581b85f-f676-44b2-a12f-c832f8de6e5f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:15 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3e426a20-78b7-4cec-ad8e-012452706d84 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "cinder-quobyte-0caae540-2f8a-45e8-96b4-7a1b80e90c9f" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:15 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.0581b85f-f676-44b2-a12f-c832f8de6e5f Sep 04 16:11:15 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:15 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3e426a20-78b7-4cec-ad8e-012452706d84 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-0caae540-2f8a-45e8-96b4-7a1b80e90c9f" acquired by "delete_volume" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:15 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[952d64c0-18a4-4a45-af23-2bd8bd7eb5df]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3e426a20-78b7-4cec-ad8e-012452706d84 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:15 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f Sep 04 16:11:15 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:15 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5bd57a9a-a198-4576-9da0-2bff23b0364d tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.0581b85f-f676-44b2-a12f-c832f8de6e5f" returned: 0 in 0.251s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5bd57a9a-a198-4576-9da0-2bff23b0364d tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:15 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.info Sep 04 16:11:15 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:15 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3e426a20-78b7-4cec-ad8e-012452706d84 tempest-ProjectReaderTests-1423655718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f" returned: 0 in 0.387s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3e426a20-78b7-4cec-ad8e-012452706d84 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:15 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f Sep 04 16:11:15 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:15 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5bd57a9a-a198-4576-9da0-2bff23b0364d tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.info" returned: 0 in 0.256s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:15 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-5bd57a9a-a198-4576-9da0-2bff23b0364d tempest-ProjectMemberTests-2060754872 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.info is being set with open permissions: ugo+rw Sep 04 16:11:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5bd57a9a-a198-4576-9da0-2bff23b0364d tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:15 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.info Sep 04 16:11:15 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:15 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:15 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3e426a20-78b7-4cec-ad8e-012452706d84 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-0caae540-2f8a-45e8-96b4-7a1b80e90c9f" returned: 0 in 0.244s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:15 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3e426a20-78b7-4cec-ad8e-012452706d84 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-quobyte-0caae540-2f8a-45e8-96b4-7a1b80e90c9f" released by "delete_volume" :: held 0.688s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-3e426a20-78b7-4cec-ad8e-012452706d84 tempest-ProjectReaderTests-1423655718 None] Created reservations ['96e040ea-b300-4be5-ab84-c5b7d2284d42', '4f4bf215-2d35-4398-bc64-714f138c2f5c', '754ff4bc-b139-4b1a-88ea-f749a1bc4094', '097af129-702b-49db-829c-9fa68cafd150'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:11:16 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-5bd57a9a-a198-4576-9da0-2bff23b0364d tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.info" returned: 0 in 0.240s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-5bd57a9a-a198-4576-9da0-2bff23b0364d tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.913s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-610e2bb4-4072-4818-ac25-414b1756dcb5 tempest-SnapshotDependencyTests-1511326164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.560s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-610e2bb4-4072-4818-ac25-414b1756dcb5 tempest-SnapshotDependencyTests-1511326164 None] Creating offline snapshot e6f43e5c-31e3-481a-b39a-dcfaf61c09c6 of volume bcc676c0-60a4-4b71-a8d4-ac7a720612ef {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[679772e2-8f8c-4e73-bab3-23afebaf2ce2]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-610e2bb4-4072-4818-ac25-414b1756dcb5 tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:16 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-5bd57a9a-a198-4576-9da0-2bff23b0364d tempest-ProjectMemberTests-2060754872 None] Create snapshot completed successfully Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3e426a20-78b7-4cec-ad8e-012452706d84 tempest-ProjectReaderTests-1423655718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3e426a20-78b7-4cec-ad8e-012452706d84 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3e426a20-78b7-4cec-ad8e-012452706d84 tempest-ProjectReaderTests-1423655718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-3e426a20-78b7-4cec-ad8e-012452706d84 tempest-ProjectReaderTests-1423655718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3e426a20-78b7-4cec-ad8e-012452706d84 tempest-ProjectReaderTests-1423655718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3e426a20-78b7-4cec-ad8e-012452706d84 tempest-ProjectReaderTests-1423655718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:16 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:11:16 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:16 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef Sep 04 16:11:16 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-0581b85f-f676-44b2-a12f-c832f8de6e5f-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-0581b85f-f676-44b2-a12f-c832f8de6e5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-b263b689-6ce0-49f6-8d68-f4f57873ed51" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-b263b689-6ce0-49f6-8d68-f4f57873ed51" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-0581b85f-f676-44b2-a12f-c832f8de6e5f" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-0581b85f-f676-44b2-a12f-c832f8de6e5f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] Deleting offline snapshot 0581b85f-f676-44b2-a12f-c832f8de6e5f of volume b263b689-6ce0-49f6-8d68-f4f57873ed51 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] snapshot_file for this snap is: volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.0581b85f-f676-44b2-a12f-c832f8de6e5f {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[710233db-6aa3-4536-b805-8aba0cd77755]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.0581b85f-f676-44b2-a12f-c832f8de6e5f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:16 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.0581b85f-f676-44b2-a12f-c832f8de6e5f Sep 04 16:11:16 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:16 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-610e2bb4-4072-4818-ac25-414b1756dcb5 tempest-SnapshotDependencyTests-1511326164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef" returned: 0 in 0.420s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-610e2bb4-4072-4818-ac25-414b1756dcb5 tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:16 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3e426a20-78b7-4cec-ad8e-012452706d84 tempest-ProjectReaderTests-1423655718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.366s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-3e426a20-78b7-4cec-ad8e-012452706d84 tempest-ProjectReaderTests-1423655718 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:11:16 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-3e426a20-78b7-4cec-ad8e-012452706d84 tempest-ProjectReaderTests-1423655718 None] Deleted volume successfully. Sep 04 16:11:16 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6 1G Sep 04 16:11:16 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-3e426a20-78b7-4cec-ad8e-012452706d84 tempest-ProjectReaderTests-1423655718 None] Lock "cinder-0caae540-2f8a-45e8-96b4-7a1b80e90c9f-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:16 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.0581b85f-f676-44b2-a12f-c832f8de6e5f" returned: 0 in 0.397s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b263b689-6ce0-49f6-8d68-f4f57873ed51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d152e635-36c1-4973-a2d2-1644e47b22d8]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:16 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51 Sep 04 16:11:16 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:16 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-610e2bb4-4072-4818-ac25-414b1756dcb5 tempest-SnapshotDependencyTests-1511326164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6 1G" returned: 0 in 0.478s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:16 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-610e2bb4-4072-4818-ac25-414b1756dcb5 tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:17 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6 Sep 04 16:11:17 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:17 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51" returned: 0 in 0.398s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.0581b85f-f676-44b2-a12f-c832f8de6e5f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:17 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.0581b85f-f676-44b2-a12f-c832f8de6e5f Sep 04 16:11:17 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:17 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-610e2bb4-4072-4818-ac25-414b1756dcb5 tempest-SnapshotDependencyTests-1511326164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6" returned: 0 in 0.303s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:17 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-610e2bb4-4072-4818-ac25-414b1756dcb5 tempest-SnapshotDependencyTests-1511326164 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6 is being set with open permissions: ugo+rw Sep 04 16:11:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-610e2bb4-4072-4818-ac25-414b1756dcb5 tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:17 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6 Sep 04 16:11:17 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:17 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.0581b85f-f676-44b2-a12f-c832f8de6e5f" returned: 0 in 0.394s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.0581b85f-f676-44b2-a12f-c832f8de6e5f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:17 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-610e2bb4-4072-4818-ac25-414b1756dcb5 tempest-SnapshotDependencyTests-1511326164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6" returned: 0 in 0.305s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:17 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.0581b85f-f676-44b2-a12f-c832f8de6e5f Sep 04 16:11:17 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-610e2bb4-4072-4818-ac25-414b1756dcb5 tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:17 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.info Sep 04 16:11:17 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:17 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51.0581b85f-f676-44b2-a12f-c832f8de6e5f" returned: 0 in 0.257s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-0581b85f-f676-44b2-a12f-c832f8de6e5f" released by "_delete_snapshot" :: held 1.555s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:17 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:17 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-b263b689-6ce0-49f6-8d68-f4f57873ed51" released by "delete_snapshot" :: held 1.584s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-610e2bb4-4072-4818-ac25-414b1756dcb5 tempest-SnapshotDependencyTests-1511326164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.info" returned: 0 in 0.266s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:17 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-610e2bb4-4072-4818-ac25-414b1756dcb5 tempest-SnapshotDependencyTests-1511326164 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.info is being set with open permissions: ugo+rw Sep 04 16:11:17 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-610e2bb4-4072-4818-ac25-414b1756dcb5 tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:17 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.info Sep 04 16:11:17 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:17 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] Created reservations ['5c396d8a-1c33-4b44-a3b3-fca683b54e32', 'b8bdcb92-a269-4b41-942a-631157a4d303', '94eb879d-eab2-48e7-b01f-f32d86dfd86b', '8558675a-0c5d-4d8f-9c7e-beea87003474'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:11:18 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] Delete snapshot completed successfully. Sep 04 16:11:18 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f5610b26-3914-4ee7-b70e-c9e053986213 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-0581b85f-f676-44b2-a12f-c832f8de6e5f-delete_snapshot" released by "delete_snapshot" :: held 1.786s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:18 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-610e2bb4-4072-4818-ac25-414b1756dcb5 tempest-SnapshotDependencyTests-1511326164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.info" returned: 0 in 0.278s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-610e2bb4-4072-4818-ac25-414b1756dcb5 tempest-SnapshotDependencyTests-1511326164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.151s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:18 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-610e2bb4-4072-4818-ac25-414b1756dcb5 tempest-SnapshotDependencyTests-1511326164 None] Create snapshot completed successfully Sep 04 16:11:18 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0fdfaf04-89d0-4a95-beec-902000b818fc tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-b263b689-6ce0-49f6-8d68-f4f57873ed51-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:18 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0fdfaf04-89d0-4a95-beec-902000b818fc tempest-ProjectMemberTests-2060754872 None] Lock "cinder-b263b689-6ce0-49f6-8d68-f4f57873ed51-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:18 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0fdfaf04-89d0-4a95-beec-902000b818fc tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-b263b689-6ce0-49f6-8d68-f4f57873ed51" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:18 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0fdfaf04-89d0-4a95-beec-902000b818fc tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-b263b689-6ce0-49f6-8d68-f4f57873ed51" acquired by "delete_volume" :: waited 0.023s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:18 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[7565e6ae-fdbb-4732-9b8c-97aca423bdf8]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0fdfaf04-89d0-4a95-beec-902000b818fc tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:18 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51 Sep 04 16:11:18 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:18 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0fdfaf04-89d0-4a95-beec-902000b818fc tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51" returned: 0 in 0.377s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:18 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0fdfaf04-89d0-4a95-beec-902000b818fc tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:18 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51 Sep 04 16:11:18 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:19 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0fdfaf04-89d0-4a95-beec-902000b818fc tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b263b689-6ce0-49f6-8d68-f4f57873ed51" returned: 0 in 0.259s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0fdfaf04-89d0-4a95-beec-902000b818fc tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-b263b689-6ce0-49f6-8d68-f4f57873ed51" released by "delete_volume" :: held 0.701s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Flow 'volume_create_manager' (66aa7568-ead7-4714-91f6-2d55bcf4d052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d2689a-18eb-4a32-95f6-8ac56a60c5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d2689a-18eb-4a32-95f6-8ac56a60c5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ff155d-e6e9-46b7-a488-dcbb1496d8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb797440971409284baaa372acf8257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e6f43e5c-31e3-481a-b39a-dcfaf61c09c6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:19Z,use_quota=True,user_id='cd002834bc604e4c88a6d1adf1896638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f573656-5bee-4692-9889-0ff9423828ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f573656-5bee-4692-9889-0ff9423828ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c6899c-b9b0-4535-aa41-088337884199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c6899c-b9b0-4535-aa41-088337884199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '18ff155d-e6e9-46b7-a488-dcbb1496d8e2', 'volume_name': 'volume-18ff155d-e6e9-46b7-a488-dcbb1496d8e2', 'volume_size': 1, 'snapshot_id': 'e6f43e5c-31e3-481a-b39a-dcfaf61c09c6'}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d9cc23-1440-4d0a-a353-63ed43e4af6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d9cc23-1440-4d0a-a353-63ed43e4af6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a20009-8411-456c-8151-fedc550bb838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:19 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Volume 18ff155d-e6e9-46b7-a488-dcbb1496d8e2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-18ff155d-e6e9-46b7-a488-dcbb1496d8e2', 'volume_size': 1, 'snapshot_id': 'e6f43e5c-31e3-481a-b39a-dcfaf61c09c6'} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-0fdfaf04-89d0-4a95-beec-902000b818fc tempest-ProjectMemberTests-2060754872 None] Created reservations ['4863c351-dba6-4b26-99ef-4c08e427fa9e', 'efb3cc13-7151-4495-be2f-30fc649494fc', 'efda4727-1779-454a-b290-1340aacb46b3', '63d34c25-70a0-4759-a144-60d687ad2927'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Acquiring lock "cinder-quobyte-e6f43e5c-31e3-481a-b39a-dcfaf61c09c6-18ff155d-e6e9-46b7-a488-dcbb1496d8e2" by "_create_volume_from_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Lock "cinder-quobyte-e6f43e5c-31e3-481a-b39a-dcfaf61c09c6-18ff155d-e6e9-46b7-a488-dcbb1496d8e2" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Creating volume 18ff155d-e6e9-46b7-a488-dcbb1496d8e2 from snapshot e6f43e5c-31e3-481a-b39a-dcfaf61c09c6 {{(pid=87513) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Acquiring lock "cinder-quobyte-18ff155d-e6e9-46b7-a488-dcbb1496d8e2" by "_copy_volume_from_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Lock "cinder-quobyte-18ff155d-e6e9-46b7-a488-dcbb1496d8e2" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] snapshot: e6f43e5c-31e3-481a-b39a-dcfaf61c09c6, volume: 18ff155d-e6e9-46b7-a488-dcbb1496d8e2, {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[745e6ebe-b6a5-42ef-a943-3341835680fd]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0fdfaf04-89d0-4a95-beec-902000b818fc tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0fdfaf04-89d0-4a95-beec-902000b818fc tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0fdfaf04-89d0-4a95-beec-902000b818fc tempest-ProjectMemberTests-2060754872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-0fdfaf04-89d0-4a95-beec-902000b818fc tempest-ProjectMemberTests-2060754872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-0fdfaf04-89d0-4a95-beec-902000b818fc tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0fdfaf04-89d0-4a95-beec-902000b818fc tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:19 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:11:19 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:19 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6 Sep 04 16:11:19 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:19 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0fdfaf04-89d0-4a95-beec-902000b818fc tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.304s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-0fdfaf04-89d0-4a95-beec-902000b818fc tempest-ProjectMemberTests-2060754872 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:11:19 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-0fdfaf04-89d0-4a95-beec-902000b818fc tempest-ProjectMemberTests-2060754872 None] Deleted volume successfully. Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0fdfaf04-89d0-4a95-beec-902000b818fc tempest-ProjectMemberTests-2060754872 None] Lock "cinder-b263b689-6ce0-49f6-8d68-f4f57873ed51-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:19 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6" returned: 0 in 0.430s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] will copy from snapshot at /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Creating direct copy from snapshot {{(pid=87513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1ee460-a119-4154-aa96-94daed4fe145]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:19 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:20 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef Sep 04 16:11:20 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Flow 'volume_create_manager' (9ded841c-3d79-4e3c-ac45-2f4b754330a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3db7db1-f512-406a-bcfb-85ad9dd26574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3db7db1-f512-406a-bcfb-85ad9dd26574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1257600468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f29407c-a787-4825-9230-52157c48ea90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb01159052a40b287cf32491b8d265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:20Z,use_quota=True,user_id='bac5509d617040ee9cc4a5e5f8232b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5e7e75-d450-4392-8fa2-bb6c62359932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5e7e75-d450-4392-8fa2-bb6c62359932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd94bd0-7e78-4094-8813-da4c6357e60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd94bd0-7e78-4094-8813-da4c6357e60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f29407c-a787-4825-9230-52157c48ea90', 'volume_name': 'volume-1f29407c-a787-4825-9230-52157c48ea90', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47ebdd6-04c5-4ef9-925a-2a75d32168a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47ebdd6-04c5-4ef9-925a-2a75d32168a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a0ace3-64d2-4cd9-9c53-2b106fc7b877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:20 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Volume 1f29407c-a787-4825-9230-52157c48ea90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f29407c-a787-4825-9230-52157c48ea90', 'volume_size': 1} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:20 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef" returned: 0 in 0.464s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.utils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Path /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-18ff155d-e6e9-46b7-a488-dcbb1496d8e2 not found in is_blk_device check {{(pid=87513) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-18ff155d-e6e9-46b7-a488-dcbb1496d8e2 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:20 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-18ff155d-e6e9-46b7-a488-dcbb1496d8e2 Sep 04 16:11:20 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Flow 'volume_create_manager' (27cb9452-a415-47cb-a841-7e9adf3430f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202c172c-99f2-49c3-b3ce-d990591201ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202c172c-99f2-49c3-b3ce-d990591201ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-389959112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51985dad-feba-4f6e-a9ee-b9b28d1faddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7b9a690acf4e74840df0655dc24ec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:20Z,use_quota=True,user_id='c9eb86b57d3e4d90975db9852fddc812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d432926f-20b3-48ae-93dd-ee7ff4e07418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d432926f-20b3-48ae-93dd-ee7ff4e07418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21f8406-174e-4789-bad4-6891d51424af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21f8406-174e-4789-bad4-6891d51424af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51985dad-feba-4f6e-a9ee-b9b28d1faddb', 'volume_name': 'volume-51985dad-feba-4f6e-a9ee-b9b28d1faddb', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a66c6b91-26d3-49bd-b7e5-b4f49a8bbf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a66c6b91-26d3-49bd-b7e5-b4f49a8bbf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b99593-265d-4880-bc5f-fffd7220e979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:20 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Volume 51985dad-feba-4f6e-a9ee-b9b28d1faddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51985dad-feba-4f6e-a9ee-b9b28d1faddb', 'volume_size': 1} Sep 04 16:11:20 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:24 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-18ff155d-e6e9-46b7-a488-dcbb1496d8e2" returned: 0 in 3.917s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:24 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fde01b4-7db2-4ead-a16e-2eba7c0a849c]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:24 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef Sep 04 16:11:24 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:24 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef" returned: 0 in 0.537s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:24 devstack cinder-volume[87513]: DEBUG cinder.image.image_utils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Image conversion details: src /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef, size 1024.00 MB, duration 3.92 sec, destination /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-18ff155d-e6e9-46b7-a488-dcbb1496d8e2 {{(pid=87513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:11:24 devstack cinder-volume[87513]: INFO cinder.image.image_utils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Converted 1024.00 MB image at 261.28 MB/s Sep 04 16:11:24 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-18ff155d-e6e9-46b7-a488-dcbb1496d8e2 is being set with open permissions: ugo+rw Sep 04 16:11:24 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-18ff155d-e6e9-46b7-a488-dcbb1496d8e2 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:24 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-18ff155d-e6e9-46b7-a488-dcbb1496d8e2 Sep 04 16:11:24 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:25 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-18ff155d-e6e9-46b7-a488-dcbb1496d8e2" returned: 0 in 0.245s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Lock "cinder-quobyte-18ff155d-e6e9-46b7-a488-dcbb1496d8e2" released by "_copy_volume_from_snapshot" :: held 5.692s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Lock "cinder-quobyte-e6f43e5c-31e3-481a-b39a-dcfaf61c09c6-18ff155d-e6e9-46b7-a488-dcbb1496d8e2" released by "_create_volume_from_snapshot" :: held 5.725s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.751s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.802s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1257600468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f29407c-a787-4825-9230-52157c48ea90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb01159052a40b287cf32491b8d265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:20Z,use_quota=True,user_id='bac5509d617040ee9cc4a5e5f8232b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Creating volume 1f29407c-a787-4825-9230-52157c48ea90 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:11:25 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:25 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90 1073741824 Sep 04 16:11:25 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a20009-8411-456c-8151-fedc550bb838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18ff155d-e6e9-46b7-a488-dcbb1496d8e2', 'volume_size': 1, 'snapshot_id': 'e6f43e5c-31e3-481a-b39a-dcfaf61c09c6'}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269566ac-44ad-41ae-88b6-a66f79c7c122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:25 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Volume volume-18ff155d-e6e9-46b7-a488-dcbb1496d8e2 (18ff155d-e6e9-46b7-a488-dcbb1496d8e2): created successfully Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269566ac-44ad-41ae-88b6-a66f79c7c122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Flow 'volume_create_manager' (66aa7568-ead7-4714-91f6-2d55bcf4d052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:25 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-09e4e3ac-985a-412d-a28c-c8814720d264 tempest-SnapshotDependencyTests-1511326164 None] Created volume successfully. Sep 04 16:11:25 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90 1073741824" returned: 0 in 0.408s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:25 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90 Sep 04 16:11:25 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:25 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90" returned: 0 in 0.250s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.241s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-389959112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51985dad-feba-4f6e-a9ee-b9b28d1faddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7b9a690acf4e74840df0655dc24ec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:20Z,use_quota=True,user_id='c9eb86b57d3e4d90975db9852fddc812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Creating volume 51985dad-feba-4f6e-a9ee-b9b28d1faddb {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:11:25 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-51985dad-feba-4f6e-a9ee-b9b28d1faddb 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] Acquiring lock "cinder-e6f43e5c-31e3-481a-b39a-dcfaf61c09c6-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:25 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-51985dad-feba-4f6e-a9ee-b9b28d1faddb 1073741824 Sep 04 16:11:25 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a0ace3-64d2-4cd9-9c53-2b106fc7b877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f29407c-a787-4825-9230-52157c48ea90', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5d73f1-329e-431a-979a-c79a6a20ffc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] Lock "cinder-e6f43e5c-31e3-481a-b39a-dcfaf61c09c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] Acquiring lock "cinder-quobyte-bcc676c0-60a4-4b71-a8d4-ac7a720612ef" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:25 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Volume volume-1f29407c-a787-4825-9230-52157c48ea90 (1f29407c-a787-4825-9230-52157c48ea90): created successfully Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5d73f1-329e-431a-979a-c79a6a20ffc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Flow 'volume_create_manager' (9ded841c-3d79-4e3c-ac45-2f4b754330a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] Lock "cinder-quobyte-bcc676c0-60a4-4b71-a8d4-ac7a720612ef" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] Acquiring lock "cinder-quobyte-e6f43e5c-31e3-481a-b39a-dcfaf61c09c6" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] Lock "cinder-quobyte-e6f43e5c-31e3-481a-b39a-dcfaf61c09c6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] Deleting offline snapshot e6f43e5c-31e3-481a-b39a-dcfaf61c09c6 of volume bcc676c0-60a4-4b71-a8d4-ac7a720612ef {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] snapshot_file for this snap is: volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:11:25 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ed5a1bfa-cc41-47cb-a93f-19b41f85700b tempest-ProjectMemberTests-2060754872 None] Created volume successfully. Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[437721a9-baad-4a87-96d2-2810602729c2]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:25 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:26 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6 Sep 04 16:11:26 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:26 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-51985dad-feba-4f6e-a9ee-b9b28d1faddb 1073741824" returned: 0 in 0.396s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-51985dad-feba-4f6e-a9ee-b9b28d1faddb {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:26 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-51985dad-feba-4f6e-a9ee-b9b28d1faddb Sep 04 16:11:26 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:26 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6" returned: 0 in 0.393s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:11:26 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dec6ca7-c18a-43ff-9446-77c5c7b6d4e1]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:26 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef Sep 04 16:11:26 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:26 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-51985dad-feba-4f6e-a9ee-b9b28d1faddb" returned: 0 in 0.253s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:11:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b99593-265d-4880-bc5f-fffd7220e979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51985dad-feba-4f6e-a9ee-b9b28d1faddb', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c0f587-b6e6-426c-8e99-e2ebeaf0b36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:26 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Volume volume-51985dad-feba-4f6e-a9ee-b9b28d1faddb (51985dad-feba-4f6e-a9ee-b9b28d1faddb): created successfully Sep 04 16:11:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c0f587-b6e6-426c-8e99-e2ebeaf0b36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:26 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Flow 'volume_create_manager' (27cb9452-a415-47cb-a841-7e9adf3430f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:26 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-bd8d7d94-3657-4588-b57a-b6ff5361189e tempest-ProjectReaderTests-1655945446 None] Created volume successfully. Sep 04 16:11:26 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef" returned: 0 in 0.365s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:26 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6 Sep 04 16:11:26 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3f4fa76b-bd4b-47ad-81c9-980bee54a30d tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3f4fa76b-bd4b-47ad-81c9-980bee54a30d tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:26 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-3f4fa76b-bd4b-47ad-81c9-980bee54a30d tempest-ProjectMemberTests-2060754872 None] Creating offline snapshot f8c93290-eb89-4bfe-bda3-e75c7ed741b0 of volume 1f29407c-a787-4825-9230-52157c48ea90 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:11:26 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8307e89f-6240-405b-a6a5-69ea1a4dc814]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:26 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f4fa76b-bd4b-47ad-81c9-980bee54a30d tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:26 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90 Sep 04 16:11:26 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:27 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6" returned: 0 in 0.350s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f6f31797-7b8c-4b5a-bbec-ff5edc860812 tempest-ProjectReaderTests-1655945446 None] Acquiring lock "cinder-51985dad-feba-4f6e-a9ee-b9b28d1faddb-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:27 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6 Sep 04 16:11:27 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f6f31797-7b8c-4b5a-bbec-ff5edc860812 tempest-ProjectReaderTests-1655945446 None] Lock "cinder-51985dad-feba-4f6e-a9ee-b9b28d1faddb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f6f31797-7b8c-4b5a-bbec-ff5edc860812 tempest-ProjectReaderTests-1655945446 None] Acquiring lock "cinder-quobyte-51985dad-feba-4f6e-a9ee-b9b28d1faddb" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f6f31797-7b8c-4b5a-bbec-ff5edc860812 tempest-ProjectReaderTests-1655945446 None] Lock "cinder-quobyte-51985dad-feba-4f6e-a9ee-b9b28d1faddb" acquired by "delete_volume" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfca3842-2854-4af2-a84d-bdf57ba5dbde]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f6f31797-7b8c-4b5a-bbec-ff5edc860812 tempest-ProjectReaderTests-1655945446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-51985dad-feba-4f6e-a9ee-b9b28d1faddb {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:27 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f4fa76b-bd4b-47ad-81c9-980bee54a30d tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90" returned: 0 in 0.414s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f4fa76b-bd4b-47ad-81c9-980bee54a30d tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.f8c93290-eb89-4bfe-bda3-e75c7ed741b0 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:27 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.f8c93290-eb89-4bfe-bda3-e75c7ed741b0 1G Sep 04 16:11:27 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:27 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef.e6f43e5c-31e3-481a-b39a-dcfaf61c09c6" returned: 0 in 0.292s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:27 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-51985dad-feba-4f6e-a9ee-b9b28d1faddb Sep 04 16:11:27 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] Lock "cinder-quobyte-e6f43e5c-31e3-481a-b39a-dcfaf61c09c6" released by "_delete_snapshot" :: held 1.507s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] Lock "cinder-quobyte-bcc676c0-60a4-4b71-a8d4-ac7a720612ef" released by "delete_snapshot" :: held 1.532s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] Created reservations ['cee6319e-2a01-464b-9753-31f5dccecf57', '618fa0dc-dfd1-42cd-b897-7ef5fd41c5c5', '8167128a-9835-4db3-98e6-4cd8d14bc6c8', 'a478997c-3c1d-49c8-b09c-49096a0b109b'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=178,cinder:INSERT=54,cinder:UPDATE=205,cinder:DELETE=18 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=214,cinder:SELECT=165,cinder:INSERT=62,cinder:DELETE=19 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:11:27 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] Delete snapshot completed successfully. Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a94b5097-71aa-41e4-ba43-596a1fd40cfe tempest-SnapshotDependencyTests-1511326164 None] Lock "cinder-e6f43e5c-31e3-481a-b39a-dcfaf61c09c6-delete_snapshot" released by "delete_snapshot" :: held 1.704s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:27 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f6f31797-7b8c-4b5a-bbec-ff5edc860812 tempest-ProjectReaderTests-1655945446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-51985dad-feba-4f6e-a9ee-b9b28d1faddb" returned: 0 in 0.433s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f6f31797-7b8c-4b5a-bbec-ff5edc860812 tempest-ProjectReaderTests-1655945446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-51985dad-feba-4f6e-a9ee-b9b28d1faddb {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:27 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f4fa76b-bd4b-47ad-81c9-980bee54a30d tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.f8c93290-eb89-4bfe-bda3-e75c7ed741b0 1G" returned: 0 in 0.436s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f4fa76b-bd4b-47ad-81c9-980bee54a30d tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f29407c-a787-4825-9230-52157c48ea90 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.f8c93290-eb89-4bfe-bda3-e75c7ed741b0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:27 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-51985dad-feba-4f6e-a9ee-b9b28d1faddb Sep 04 16:11:27 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:27 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f29407c-a787-4825-9230-52157c48ea90 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.f8c93290-eb89-4bfe-bda3-e75c7ed741b0 Sep 04 16:11:27 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:27 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f6f31797-7b8c-4b5a-bbec-ff5edc860812 tempest-ProjectReaderTests-1655945446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-51985dad-feba-4f6e-a9ee-b9b28d1faddb" returned: 0 in 0.267s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:27 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f6f31797-7b8c-4b5a-bbec-ff5edc860812 tempest-ProjectReaderTests-1655945446 None] Lock "cinder-quobyte-51985dad-feba-4f6e-a9ee-b9b28d1faddb" released by "delete_volume" :: held 0.743s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:28 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f4fa76b-bd4b-47ad-81c9-980bee54a30d tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f29407c-a787-4825-9230-52157c48ea90 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.f8c93290-eb89-4bfe-bda3-e75c7ed741b0" returned: 0 in 0.302s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:28 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-3f4fa76b-bd4b-47ad-81c9-980bee54a30d tempest-ProjectMemberTests-2060754872 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.f8c93290-eb89-4bfe-bda3-e75c7ed741b0 is being set with open permissions: ugo+rw Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f4fa76b-bd4b-47ad-81c9-980bee54a30d tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.f8c93290-eb89-4bfe-bda3-e75c7ed741b0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e4f76f1d-69a8-493c-8ca7-d300bb99233d tempest-SnapshotDependencyTests-1511326164 None] Acquiring lock "cinder-bcc676c0-60a4-4b71-a8d4-ac7a720612ef-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:28 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.f8c93290-eb89-4bfe-bda3-e75c7ed741b0 Sep 04 16:11:28 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e4f76f1d-69a8-493c-8ca7-d300bb99233d tempest-SnapshotDependencyTests-1511326164 None] Lock "cinder-bcc676c0-60a4-4b71-a8d4-ac7a720612ef-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-f6f31797-7b8c-4b5a-bbec-ff5edc860812 tempest-ProjectReaderTests-1655945446 None] Created reservations ['981c858c-0a86-4e4c-ad67-c12ce66962d9', 'd626baa3-393d-45d1-916f-868a415372d7', '4cc769cd-0f5d-440a-840e-c2e58e218a16', '14b997b8-ccc5-403d-b147-65144912734c'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e4f76f1d-69a8-493c-8ca7-d300bb99233d tempest-SnapshotDependencyTests-1511326164 None] Acquiring lock "cinder-quobyte-bcc676c0-60a4-4b71-a8d4-ac7a720612ef" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e4f76f1d-69a8-493c-8ca7-d300bb99233d tempest-SnapshotDependencyTests-1511326164 None] Lock "cinder-quobyte-bcc676c0-60a4-4b71-a8d4-ac7a720612ef" acquired by "delete_volume" :: waited 0.027s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f6f31797-7b8c-4b5a-bbec-ff5edc860812 tempest-ProjectReaderTests-1655945446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f6f31797-7b8c-4b5a-bbec-ff5edc860812 tempest-ProjectReaderTests-1655945446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f6f31797-7b8c-4b5a-bbec-ff5edc860812 tempest-ProjectReaderTests-1655945446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-f6f31797-7b8c-4b5a-bbec-ff5edc860812 tempest-ProjectReaderTests-1655945446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-f6f31797-7b8c-4b5a-bbec-ff5edc860812 tempest-ProjectReaderTests-1655945446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f6f31797-7b8c-4b5a-bbec-ff5edc860812 tempest-ProjectReaderTests-1655945446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f413e70-ae77-45ea-94dd-f11b6075cbc5]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e4f76f1d-69a8-493c-8ca7-d300bb99233d tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:28 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:11:28 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:28 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f4fa76b-bd4b-47ad-81c9-980bee54a30d tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.f8c93290-eb89-4bfe-bda3-e75c7ed741b0" returned: 0 in 0.296s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f4fa76b-bd4b-47ad-81c9-980bee54a30d tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:28 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef Sep 04 16:11:28 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:28 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.info Sep 04 16:11:28 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:28 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-f6f31797-7b8c-4b5a-bbec-ff5edc860812 tempest-ProjectReaderTests-1655945446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.321s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-f6f31797-7b8c-4b5a-bbec-ff5edc860812 tempest-ProjectReaderTests-1655945446 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:11:28 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-f6f31797-7b8c-4b5a-bbec-ff5edc860812 tempest-ProjectReaderTests-1655945446 None] Deleted volume successfully. Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-f6f31797-7b8c-4b5a-bbec-ff5edc860812 tempest-ProjectReaderTests-1655945446 None] Lock "cinder-51985dad-feba-4f6e-a9ee-b9b28d1faddb-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:28 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e4f76f1d-69a8-493c-8ca7-d300bb99233d tempest-SnapshotDependencyTests-1511326164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef" returned: 0 in 0.460s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e4f76f1d-69a8-493c-8ca7-d300bb99233d tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:28 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef Sep 04 16:11:28 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:28 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f4fa76b-bd4b-47ad-81c9-980bee54a30d tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.info" returned: 0 in 0.379s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:28 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-3f4fa76b-bd4b-47ad-81c9-980bee54a30d tempest-ProjectMemberTests-2060754872 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.info is being set with open permissions: ugo+rw Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f4fa76b-bd4b-47ad-81c9-980bee54a30d tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:28 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.info Sep 04 16:11:28 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Flow 'volume_create_manager' (33f78226-f51c-45d8-b77d-9c97b672674e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:28 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b97654a-c8de-4ccb-beff-f009ff67a63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e4f76f1d-69a8-493c-8ca7-d300bb99233d tempest-SnapshotDependencyTests-1511326164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-bcc676c0-60a4-4b71-a8d4-ac7a720612ef" returned: 0 in 0.290s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:28 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b97654a-c8de-4ccb-beff-f009ff67a63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1323529548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80fd52bd-b1da-4b6a-94f1-5d655e842194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7b9a690acf4e74840df0655dc24ec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:29Z,use_quota=True,user_id='c9eb86b57d3e4d90975db9852fddc812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f872b8-96e9-42b1-a7b2-0e13443138c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f872b8-96e9-42b1-a7b2-0e13443138c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e35367a8-cca3-464b-a86a-1a1b5d7e1d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e35367a8-cca3-464b-a86a-1a1b5d7e1d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80fd52bd-b1da-4b6a-94f1-5d655e842194', 'volume_name': 'volume-80fd52bd-b1da-4b6a-94f1-5d655e842194', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (443c6a8d-eb44-48e3-b325-1b24e71db0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (443c6a8d-eb44-48e3-b325-1b24e71db0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:29 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb01a28-ec10-4658-82e8-ba3e19586b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:29 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Volume 80fd52bd-b1da-4b6a-94f1-5d655e842194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80fd52bd-b1da-4b6a-94f1-5d655e842194', 'volume_size': 1} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e4f76f1d-69a8-493c-8ca7-d300bb99233d tempest-SnapshotDependencyTests-1511326164 None] Lock "cinder-quobyte-bcc676c0-60a4-4b71-a8d4-ac7a720612ef" released by "delete_volume" :: held 0.883s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-3f4fa76b-bd4b-47ad-81c9-980bee54a30d tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.info" returned: 0 in 0.306s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-3f4fa76b-bd4b-47ad-81c9-980bee54a30d tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.230s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.024s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1323529548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80fd52bd-b1da-4b6a-94f1-5d655e842194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7b9a690acf4e74840df0655dc24ec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:29Z,use_quota=True,user_id='c9eb86b57d3e4d90975db9852fddc812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Creating volume 80fd52bd-b1da-4b6a-94f1-5d655e842194 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:11:29 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-80fd52bd-b1da-4b6a-94f1-5d655e842194 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:29 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-80fd52bd-b1da-4b6a-94f1-5d655e842194 1073741824 Sep 04 16:11:29 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:29 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-3f4fa76b-bd4b-47ad-81c9-980bee54a30d tempest-ProjectMemberTests-2060754872 None] Create snapshot completed successfully Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-e4f76f1d-69a8-493c-8ca7-d300bb99233d tempest-SnapshotDependencyTests-1511326164 None] Created reservations ['3509c7ba-d8ad-420a-a8a1-fd5594d0a3d9', '7cac23cb-1c88-4039-b749-75426b6fa177', '22982d40-7ff1-4bdb-b292-ddce53c2cdb1', '44a3bb6c-f0e4-469f-b707-70a07566f376'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e4f76f1d-69a8-493c-8ca7-d300bb99233d tempest-SnapshotDependencyTests-1511326164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e4f76f1d-69a8-493c-8ca7-d300bb99233d tempest-SnapshotDependencyTests-1511326164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e4f76f1d-69a8-493c-8ca7-d300bb99233d tempest-SnapshotDependencyTests-1511326164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-e4f76f1d-69a8-493c-8ca7-d300bb99233d tempest-SnapshotDependencyTests-1511326164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-e4f76f1d-69a8-493c-8ca7-d300bb99233d tempest-SnapshotDependencyTests-1511326164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e4f76f1d-69a8-493c-8ca7-d300bb99233d tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:29 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:11:29 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:29 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:29 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-80fd52bd-b1da-4b6a-94f1-5d655e842194 1073741824" returned: 0 in 0.396s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-e4f76f1d-69a8-493c-8ca7-d300bb99233d tempest-SnapshotDependencyTests-1511326164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.255s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-e4f76f1d-69a8-493c-8ca7-d300bb99233d tempest-SnapshotDependencyTests-1511326164 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:11:29 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-e4f76f1d-69a8-493c-8ca7-d300bb99233d tempest-SnapshotDependencyTests-1511326164 None] Deleted volume successfully. Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-e4f76f1d-69a8-493c-8ca7-d300bb99233d tempest-SnapshotDependencyTests-1511326164 None] Lock "cinder-bcc676c0-60a4-4b71-a8d4-ac7a720612ef-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-80fd52bd-b1da-4b6a-94f1-5d655e842194 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:29 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-80fd52bd-b1da-4b6a-94f1-5d655e842194 Sep 04 16:11:29 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:29 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-80fd52bd-b1da-4b6a-94f1-5d655e842194" returned: 0 in 0.236s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb01a28-ec10-4658-82e8-ba3e19586b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80fd52bd-b1da-4b6a-94f1-5d655e842194', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1105e1e6-2e8c-47c3-ab23-1ad4142ed337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:29 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Volume volume-80fd52bd-b1da-4b6a-94f1-5d655e842194 (80fd52bd-b1da-4b6a-94f1-5d655e842194): created successfully Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1105e1e6-2e8c-47c3-ab23-1ad4142ed337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Flow 'volume_create_manager' (33f78226-f51c-45d8-b77d-9c97b672674e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:29 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ef7674d1-2844-487d-b6e8-0a69098c9ed9 tempest-ProjectReaderTests-1655945446 None] Created volume successfully. Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c5a734f7-e78a-4729-9c29-cf7c34b46301 tempest-ProjectReaderTests-1655945446 None] Acquiring lock "cinder-80fd52bd-b1da-4b6a-94f1-5d655e842194-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c5a734f7-e78a-4729-9c29-cf7c34b46301 tempest-ProjectReaderTests-1655945446 None] Lock "cinder-80fd52bd-b1da-4b6a-94f1-5d655e842194-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:29 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-f8c93290-eb89-4bfe-bda3-e75c7ed741b0-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c5a734f7-e78a-4729-9c29-cf7c34b46301 tempest-ProjectReaderTests-1655945446 None] Acquiring lock "cinder-quobyte-80fd52bd-b1da-4b6a-94f1-5d655e842194" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c5a734f7-e78a-4729-9c29-cf7c34b46301 tempest-ProjectReaderTests-1655945446 None] Lock "cinder-quobyte-80fd52bd-b1da-4b6a-94f1-5d655e842194" acquired by "delete_volume" :: waited 0.022s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-f8c93290-eb89-4bfe-bda3-e75c7ed741b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-1f29407c-a787-4825-9230-52157c48ea90" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd56f55-0546-40c5-a313-05599f3cdcf1]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c5a734f7-e78a-4729-9c29-cf7c34b46301 tempest-ProjectReaderTests-1655945446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-80fd52bd-b1da-4b6a-94f1-5d655e842194 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-1f29407c-a787-4825-9230-52157c48ea90" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-f8c93290-eb89-4bfe-bda3-e75c7ed741b0" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-f8c93290-eb89-4bfe-bda3-e75c7ed741b0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] Deleting offline snapshot f8c93290-eb89-4bfe-bda3-e75c7ed741b0 of volume 1f29407c-a787-4825-9230-52157c48ea90 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] snapshot_file for this snap is: volume-1f29407c-a787-4825-9230-52157c48ea90.f8c93290-eb89-4bfe-bda3-e75c7ed741b0 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[25656199-e22f-43fe-a866-d6363096395b]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.f8c93290-eb89-4bfe-bda3-e75c7ed741b0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:30 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-80fd52bd-b1da-4b6a-94f1-5d655e842194 Sep 04 16:11:30 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:30 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.f8c93290-eb89-4bfe-bda3-e75c7ed741b0 Sep 04 16:11:30 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6b088f89-b1a6-48cb-847c-e490cc9b5f27 tempest-SnapshotDependencyTests-1511326164 None] Acquiring lock "cinder-18ff155d-e6e9-46b7-a488-dcbb1496d8e2-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6b088f89-b1a6-48cb-847c-e490cc9b5f27 tempest-SnapshotDependencyTests-1511326164 None] Lock "cinder-18ff155d-e6e9-46b7-a488-dcbb1496d8e2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6b088f89-b1a6-48cb-847c-e490cc9b5f27 tempest-SnapshotDependencyTests-1511326164 None] Acquiring lock "cinder-quobyte-18ff155d-e6e9-46b7-a488-dcbb1496d8e2" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6b088f89-b1a6-48cb-847c-e490cc9b5f27 tempest-SnapshotDependencyTests-1511326164 None] Lock "cinder-quobyte-18ff155d-e6e9-46b7-a488-dcbb1496d8e2" acquired by "delete_volume" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16d6fda-92ba-4534-85bd-e0c74ddb1679]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6b088f89-b1a6-48cb-847c-e490cc9b5f27 tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-18ff155d-e6e9-46b7-a488-dcbb1496d8e2 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:30 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c5a734f7-e78a-4729-9c29-cf7c34b46301 tempest-ProjectReaderTests-1655945446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-80fd52bd-b1da-4b6a-94f1-5d655e842194" returned: 0 in 0.392s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c5a734f7-e78a-4729-9c29-cf7c34b46301 tempest-ProjectReaderTests-1655945446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-80fd52bd-b1da-4b6a-94f1-5d655e842194 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:30 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-80fd52bd-b1da-4b6a-94f1-5d655e842194 Sep 04 16:11:30 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:30 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:30 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-18ff155d-e6e9-46b7-a488-dcbb1496d8e2 Sep 04 16:11:30 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.f8c93290-eb89-4bfe-bda3-e75c7ed741b0" returned: 0 in 0.409s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f29407c-a787-4825-9230-52157c48ea90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adee67e-c4c4-4d3e-b968-cc21f3f4f825]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:30 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90 Sep 04 16:11:30 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:30 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c5a734f7-e78a-4729-9c29-cf7c34b46301 tempest-ProjectReaderTests-1655945446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-80fd52bd-b1da-4b6a-94f1-5d655e842194" returned: 0 in 0.294s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c5a734f7-e78a-4729-9c29-cf7c34b46301 tempest-ProjectReaderTests-1655945446 None] Lock "cinder-quobyte-80fd52bd-b1da-4b6a-94f1-5d655e842194" released by "delete_volume" :: held 0.726s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:30 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6b088f89-b1a6-48cb-847c-e490cc9b5f27 tempest-SnapshotDependencyTests-1511326164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-18ff155d-e6e9-46b7-a488-dcbb1496d8e2" returned: 0 in 0.381s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6b088f89-b1a6-48cb-847c-e490cc9b5f27 tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-18ff155d-e6e9-46b7-a488-dcbb1496d8e2 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:30 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-18ff155d-e6e9-46b7-a488-dcbb1496d8e2 Sep 04 16:11:30 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-c5a734f7-e78a-4729-9c29-cf7c34b46301 tempest-ProjectReaderTests-1655945446 None] Created reservations ['4db7691b-f35e-496f-9b05-8ff62d3ba43e', 'aa557f5a-9298-4149-9fd5-76750cedce23', '4297f690-a929-4638-a72e-f5681d688bf5', 'bfa85a10-b1d6-4da8-9f44-0ad0cb70d7b6'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c5a734f7-e78a-4729-9c29-cf7c34b46301 tempest-ProjectReaderTests-1655945446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c5a734f7-e78a-4729-9c29-cf7c34b46301 tempest-ProjectReaderTests-1655945446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c5a734f7-e78a-4729-9c29-cf7c34b46301 tempest-ProjectReaderTests-1655945446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-c5a734f7-e78a-4729-9c29-cf7c34b46301 tempest-ProjectReaderTests-1655945446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-c5a734f7-e78a-4729-9c29-cf7c34b46301 tempest-ProjectReaderTests-1655945446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c5a734f7-e78a-4729-9c29-cf7c34b46301 tempest-ProjectReaderTests-1655945446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:30 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:11:30 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:30 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90" returned: 0 in 0.395s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:30 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.f8c93290-eb89-4bfe-bda3-e75c7ed741b0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:30 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.f8c93290-eb89-4bfe-bda3-e75c7ed741b0 Sep 04 16:11:30 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:31 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6b088f89-b1a6-48cb-847c-e490cc9b5f27 tempest-SnapshotDependencyTests-1511326164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-18ff155d-e6e9-46b7-a488-dcbb1496d8e2" returned: 0 in 0.284s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6b088f89-b1a6-48cb-847c-e490cc9b5f27 tempest-SnapshotDependencyTests-1511326164 None] Lock "cinder-quobyte-18ff155d-e6e9-46b7-a488-dcbb1496d8e2" released by "delete_volume" :: held 0.711s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-6b088f89-b1a6-48cb-847c-e490cc9b5f27 tempest-SnapshotDependencyTests-1511326164 None] Created reservations ['53d7f621-5dae-4f4a-bf6e-1b798d0c0aed', 'c5c15b15-98be-4b6d-adbf-636a81401992', '3aebbc9e-2701-4d1f-934e-13b9d5167c73', 'be22076e-52dd-4a39-a792-cdebb88b4bf4'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:11:31 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c5a734f7-e78a-4729-9c29-cf7c34b46301 tempest-ProjectReaderTests-1655945446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.289s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-c5a734f7-e78a-4729-9c29-cf7c34b46301 tempest-ProjectReaderTests-1655945446 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:11:31 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-c5a734f7-e78a-4729-9c29-cf7c34b46301 tempest-ProjectReaderTests-1655945446 None] Deleted volume successfully. Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c5a734f7-e78a-4729-9c29-cf7c34b46301 tempest-ProjectReaderTests-1655945446 None] Lock "cinder-80fd52bd-b1da-4b6a-94f1-5d655e842194-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6b088f89-b1a6-48cb-847c-e490cc9b5f27 tempest-SnapshotDependencyTests-1511326164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6b088f89-b1a6-48cb-847c-e490cc9b5f27 tempest-SnapshotDependencyTests-1511326164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6b088f89-b1a6-48cb-847c-e490cc9b5f27 tempest-SnapshotDependencyTests-1511326164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6b088f89-b1a6-48cb-847c-e490cc9b5f27 tempest-SnapshotDependencyTests-1511326164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6b088f89-b1a6-48cb-847c-e490cc9b5f27 tempest-SnapshotDependencyTests-1511326164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6b088f89-b1a6-48cb-847c-e490cc9b5f27 tempest-SnapshotDependencyTests-1511326164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:31 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:11:31 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:31 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.f8c93290-eb89-4bfe-bda3-e75c7ed741b0" returned: 0 in 0.416s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.f8c93290-eb89-4bfe-bda3-e75c7ed741b0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:31 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.f8c93290-eb89-4bfe-bda3-e75c7ed741b0 Sep 04 16:11:31 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:31 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6b088f89-b1a6-48cb-847c-e490cc9b5f27 tempest-SnapshotDependencyTests-1511326164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.312s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-6b088f89-b1a6-48cb-847c-e490cc9b5f27 tempest-SnapshotDependencyTests-1511326164 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:11:31 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-6b088f89-b1a6-48cb-847c-e490cc9b5f27 tempest-SnapshotDependencyTests-1511326164 None] Deleted volume successfully. Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6b088f89-b1a6-48cb-847c-e490cc9b5f27 tempest-SnapshotDependencyTests-1511326164 None] Lock "cinder-18ff155d-e6e9-46b7-a488-dcbb1496d8e2-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:31 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90.f8c93290-eb89-4bfe-bda3-e75c7ed741b0" returned: 0 in 0.323s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-f8c93290-eb89-4bfe-bda3-e75c7ed741b0" released by "_delete_snapshot" :: held 1.649s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-1f29407c-a787-4825-9230-52157c48ea90" released by "delete_snapshot" :: held 1.680s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] Created reservations ['415c297e-f9eb-472b-bbcf-a188152059ec', '30e618f6-d37a-4f51-9f54-d634a678d3ce', '2946a98a-4a6a-48a5-a15d-89c35e9ae9c7', '9480f558-5fb2-4c7e-ac9f-c48ed152e434'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:11:31 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] Delete snapshot completed successfully. Sep 04 16:11:31 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-0504d4c9-8855-47e1-9d23-be6aabfb4d75 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-f8c93290-eb89-4bfe-bda3-e75c7ed741b0-delete_snapshot" released by "delete_snapshot" :: held 1.840s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-79f78c9e-b454-475c-b5ce-1c603c934924 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-1f29407c-a787-4825-9230-52157c48ea90-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-79f78c9e-b454-475c-b5ce-1c603c934924 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-1f29407c-a787-4825-9230-52157c48ea90-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-79f78c9e-b454-475c-b5ce-1c603c934924 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-1f29407c-a787-4825-9230-52157c48ea90" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:32 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-79f78c9e-b454-475c-b5ce-1c603c934924 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-1f29407c-a787-4825-9230-52157c48ea90" acquired by "delete_volume" :: waited 0.019s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:32 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed24167f-4617-4778-8cc2-20b8f47bb45a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79f78c9e-b454-475c-b5ce-1c603c934924 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:32 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90 Sep 04 16:11:32 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:32 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79f78c9e-b454-475c-b5ce-1c603c934924 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90" returned: 0 in 0.462s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:32 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79f78c9e-b454-475c-b5ce-1c603c934924 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:32 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90 Sep 04 16:11:32 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:33 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79f78c9e-b454-475c-b5ce-1c603c934924 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-1f29407c-a787-4825-9230-52157c48ea90" returned: 0 in 0.285s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-79f78c9e-b454-475c-b5ce-1c603c934924 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-1f29407c-a787-4825-9230-52157c48ea90" released by "delete_volume" :: held 0.818s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-79f78c9e-b454-475c-b5ce-1c603c934924 tempest-ProjectMemberTests-2060754872 None] Created reservations ['f1279951-60eb-4875-b212-a4722b5bd711', 'c276df6a-6444-4db5-b460-b55e21ee22d6', '7515dbf8-90bf-428a-93cf-a71d32258a42', '6ecc709e-c7dc-4180-b04f-1da680e215ff'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-79f78c9e-b454-475c-b5ce-1c603c934924 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-79f78c9e-b454-475c-b5ce-1c603c934924 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-79f78c9e-b454-475c-b5ce-1c603c934924 tempest-ProjectMemberTests-2060754872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-79f78c9e-b454-475c-b5ce-1c603c934924 tempest-ProjectMemberTests-2060754872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-79f78c9e-b454-475c-b5ce-1c603c934924 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79f78c9e-b454-475c-b5ce-1c603c934924 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:33 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:11:33 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:33 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-79f78c9e-b454-475c-b5ce-1c603c934924 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.282s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-79f78c9e-b454-475c-b5ce-1c603c934924 tempest-ProjectMemberTests-2060754872 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:11:33 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-79f78c9e-b454-475c-b5ce-1c603c934924 tempest-ProjectMemberTests-2060754872 None] Deleted volume successfully. Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-79f78c9e-b454-475c-b5ce-1c603c934924 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-1f29407c-a787-4825-9230-52157c48ea90-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Flow 'volume_create_manager' (7309e570-71eb-42d3-8152-fd5060d8a8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df07d96-b8e5-4243-9182-d287f64f7164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df07d96-b8e5-4243-9182-d287f64f7164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1655995858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d11c6e9e-7b0d-4473-adba-2db089c16ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb01159052a40b287cf32491b8d265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:34Z,use_quota=True,user_id='bac5509d617040ee9cc4a5e5f8232b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ff36a1-60f0-4302-8e34-369302f3760e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ff36a1-60f0-4302-8e34-369302f3760e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05a884c-5a20-4b49-a90c-6e44ca68044d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05a884c-5a20-4b49-a90c-6e44ca68044d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd11c6e9e-7b0d-4473-adba-2db089c16ead', 'volume_name': 'volume-d11c6e9e-7b0d-4473-adba-2db089c16ead', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa922a2-ba90-486c-902f-ee6a7412ab1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa922a2-ba90-486c-902f-ee6a7412ab1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d03611-e55e-4cd7-8b80-622c8f8afb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:33 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Volume d11c6e9e-7b0d-4473-adba-2db089c16ead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d11c6e9e-7b0d-4473-adba-2db089c16ead', 'volume_size': 1} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1655995858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d11c6e9e-7b0d-4473-adba-2db089c16ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb01159052a40b287cf32491b8d265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:34Z,use_quota=True,user_id='bac5509d617040ee9cc4a5e5f8232b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Creating volume d11c6e9e-7b0d-4473-adba-2db089c16ead {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:11:33 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:11:33 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:33 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead 1073741824 Sep 04 16:11:33 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:34 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead 1073741824" returned: 0 in 0.457s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:34 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead Sep 04 16:11:34 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:34 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead" returned: 0 in 0.253s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:11:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d03611-e55e-4cd7-8b80-622c8f8afb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d11c6e9e-7b0d-4473-adba-2db089c16ead', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1cf095e-bab1-4f41-b199-a3f7a83330bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:34 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Volume volume-d11c6e9e-7b0d-4473-adba-2db089c16ead (d11c6e9e-7b0d-4473-adba-2db089c16ead): created successfully Sep 04 16:11:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1cf095e-bab1-4f41-b199-a3f7a83330bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:34 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Flow 'volume_create_manager' (7309e570-71eb-42d3-8152-fd5060d8a8e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:34 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-fdeacd4e-499c-4e7b-ae50-6c3b1dfe693e tempest-ProjectMemberTests-2060754872 None] Created volume successfully. Sep 04 16:11:34 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:11:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:34 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:34 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:11:34 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7555bafb-2ae1-449c-a42f-bcc87cc345ab tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:34 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7555bafb-2ae1-449c-a42f-bcc87cc345ab tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:35 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-7555bafb-2ae1-449c-a42f-bcc87cc345ab tempest-ProjectMemberTests-2060754872 None] Creating offline snapshot a5ee0570-f2ed-49c9-927a-0e01f383bd78 of volume d11c6e9e-7b0d-4473-adba-2db089c16ead {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:11:35 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d430102d-ac7a-4aae-b240-e9711eee2eb8]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7555bafb-2ae1-449c-a42f-bcc87cc345ab tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:35 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead Sep 04 16:11:35 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:35 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.271s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:35 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:11:35 devstack cinder-volume[87513]: DEBUG oslo_service.periodic_task [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] Running periodic task VolumeManager._thread_info {{(pid=87513) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:11:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread count: 28 {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:11:35 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-bf6733fa-4e73-45c5-9a93-f041439106f1 None None] thread info: [<_MainThread(MainThread, started 124551868317824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87513) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 16:11:35 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7555bafb-2ae1-449c-a42f-bcc87cc345ab tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead" returned: 0 in 0.441s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7555bafb-2ae1-449c-a42f-bcc87cc345ab tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.a5ee0570-f2ed-49c9-927a-0e01f383bd78 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:35 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.a5ee0570-f2ed-49c9-927a-0e01f383bd78 1G Sep 04 16:11:35 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:35 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7555bafb-2ae1-449c-a42f-bcc87cc345ab tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.a5ee0570-f2ed-49c9-927a-0e01f383bd78 1G" returned: 0 in 0.415s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:35 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7555bafb-2ae1-449c-a42f-bcc87cc345ab tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d11c6e9e-7b0d-4473-adba-2db089c16ead -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.a5ee0570-f2ed-49c9-927a-0e01f383bd78 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:35 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d11c6e9e-7b0d-4473-adba-2db089c16ead -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.a5ee0570-f2ed-49c9-927a-0e01f383bd78 Sep 04 16:11:35 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:36 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7555bafb-2ae1-449c-a42f-bcc87cc345ab tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d11c6e9e-7b0d-4473-adba-2db089c16ead -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.a5ee0570-f2ed-49c9-927a-0e01f383bd78" returned: 0 in 0.341s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:36 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-7555bafb-2ae1-449c-a42f-bcc87cc345ab tempest-ProjectMemberTests-2060754872 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.a5ee0570-f2ed-49c9-927a-0e01f383bd78 is being set with open permissions: ugo+rw Sep 04 16:11:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7555bafb-2ae1-449c-a42f-bcc87cc345ab tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.a5ee0570-f2ed-49c9-927a-0e01f383bd78 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:36 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.a5ee0570-f2ed-49c9-927a-0e01f383bd78 Sep 04 16:11:36 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:36 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7555bafb-2ae1-449c-a42f-bcc87cc345ab tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.a5ee0570-f2ed-49c9-927a-0e01f383bd78" returned: 0 in 0.278s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7555bafb-2ae1-449c-a42f-bcc87cc345ab tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:36 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.info Sep 04 16:11:36 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:36 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7555bafb-2ae1-449c-a42f-bcc87cc345ab tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.info" returned: 0 in 0.275s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:36 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-7555bafb-2ae1-449c-a42f-bcc87cc345ab tempest-ProjectMemberTests-2060754872 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.info is being set with open permissions: ugo+rw Sep 04 16:11:36 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7555bafb-2ae1-449c-a42f-bcc87cc345ab tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:36 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.info Sep 04 16:11:36 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:37 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-7555bafb-2ae1-449c-a42f-bcc87cc345ab tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.info" returned: 0 in 0.285s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:37 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-7555bafb-2ae1-449c-a42f-bcc87cc345ab tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.143s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:37 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-7555bafb-2ae1-449c-a42f-bcc87cc345ab tempest-ProjectMemberTests-2060754872 None] Create snapshot completed successfully Sep 04 16:11:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-a5ee0570-f2ed-49c9-927a-0e01f383bd78-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-a5ee0570-f2ed-49c9-927a-0e01f383bd78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-d11c6e9e-7b0d-4473-adba-2db089c16ead" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-d11c6e9e-7b0d-4473-adba-2db089c16ead" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-a5ee0570-f2ed-49c9-927a-0e01f383bd78" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:38 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-a5ee0570-f2ed-49c9-927a-0e01f383bd78" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:38 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] Deleting offline snapshot a5ee0570-f2ed-49c9-927a-0e01f383bd78 of volume d11c6e9e-7b0d-4473-adba-2db089c16ead {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:11:38 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] snapshot_file for this snap is: volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.a5ee0570-f2ed-49c9-927a-0e01f383bd78 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:11:38 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfe754f-9690-41d4-a72f-1fff1592cf75]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.a5ee0570-f2ed-49c9-927a-0e01f383bd78 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:38 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.a5ee0570-f2ed-49c9-927a-0e01f383bd78 Sep 04 16:11:38 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:38 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.a5ee0570-f2ed-49c9-927a-0e01f383bd78" returned: 0 in 0.376s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:38 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d11c6e9e-7b0d-4473-adba-2db089c16ead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:11:38 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23f47b9-ec91-4f64-a69b-48fb748862ea]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:38 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead Sep 04 16:11:38 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:38 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead" returned: 0 in 0.340s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:38 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.a5ee0570-f2ed-49c9-927a-0e01f383bd78 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:38 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.a5ee0570-f2ed-49c9-927a-0e01f383bd78 Sep 04 16:11:38 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:39 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.a5ee0570-f2ed-49c9-927a-0e01f383bd78" returned: 0 in 0.327s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.a5ee0570-f2ed-49c9-927a-0e01f383bd78 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:39 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.a5ee0570-f2ed-49c9-927a-0e01f383bd78 Sep 04 16:11:39 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:39 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:39 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead.a5ee0570-f2ed-49c9-927a-0e01f383bd78" returned: 0 in 0.260s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-a5ee0570-f2ed-49c9-927a-0e01f383bd78" released by "_delete_snapshot" :: held 1.432s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-d11c6e9e-7b0d-4473-adba-2db089c16ead" released by "delete_snapshot" :: held 1.455s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:39 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] Created reservations ['360f6e2e-9542-4b98-adbc-a8bd35dc19d5', '8b89781a-b28e-4f02-adb0-874cdcd000f0', '0dfb44cb-866e-40a0-8ba1-041247f3f744', 'f2d3d611-4d51-4d50-9f09-475fbce1d2b2'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:11:39 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] Delete snapshot completed successfully. Sep 04 16:11:39 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-9e581079-4f90-42e1-b3a2-fbb898240816 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-a5ee0570-f2ed-49c9-927a-0e01f383bd78-delete_snapshot" released by "delete_snapshot" :: held 1.603s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ecba62d6-b0fa-44ed-b39b-c58257b64a91 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-d11c6e9e-7b0d-4473-adba-2db089c16ead-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ecba62d6-b0fa-44ed-b39b-c58257b64a91 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-d11c6e9e-7b0d-4473-adba-2db089c16ead-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ecba62d6-b0fa-44ed-b39b-c58257b64a91 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-d11c6e9e-7b0d-4473-adba-2db089c16ead" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:40 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ecba62d6-b0fa-44ed-b39b-c58257b64a91 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-d11c6e9e-7b0d-4473-adba-2db089c16ead" acquired by "delete_volume" :: waited 0.016s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:40 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef673d7-750c-4da1-98f6-e61efe2cd8b7]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ecba62d6-b0fa-44ed-b39b-c58257b64a91 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:40 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead Sep 04 16:11:40 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:40 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ecba62d6-b0fa-44ed-b39b-c58257b64a91 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead" returned: 0 in 0.384s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:40 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ecba62d6-b0fa-44ed-b39b-c58257b64a91 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:40 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead Sep 04 16:11:40 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:41 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ecba62d6-b0fa-44ed-b39b-c58257b64a91 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-d11c6e9e-7b0d-4473-adba-2db089c16ead" returned: 0 in 0.251s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ecba62d6-b0fa-44ed-b39b-c58257b64a91 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-d11c6e9e-7b0d-4473-adba-2db089c16ead" released by "delete_volume" :: held 0.700s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:41 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-ecba62d6-b0fa-44ed-b39b-c58257b64a91 tempest-ProjectMemberTests-2060754872 None] Created reservations ['2a182269-748b-4a46-8032-f4c89415997d', '0f246d99-266f-4237-a9c8-628f9e1b1457', '9f24460d-57c7-4e3b-88f3-28e9ac700e93', '7aa6f617-0c67-4108-bc26-3d268947b095'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:11:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ecba62d6-b0fa-44ed-b39b-c58257b64a91 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ecba62d6-b0fa-44ed-b39b-c58257b64a91 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:41 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ecba62d6-b0fa-44ed-b39b-c58257b64a91 tempest-ProjectMemberTests-2060754872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:41 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ecba62d6-b0fa-44ed-b39b-c58257b64a91 tempest-ProjectMemberTests-2060754872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ecba62d6-b0fa-44ed-b39b-c58257b64a91 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ecba62d6-b0fa-44ed-b39b-c58257b64a91 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:41 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:11:41 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:41 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:41 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ecba62d6-b0fa-44ed-b39b-c58257b64a91 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.263s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:41 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-ecba62d6-b0fa-44ed-b39b-c58257b64a91 tempest-ProjectMemberTests-2060754872 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:11:41 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ecba62d6-b0fa-44ed-b39b-c58257b64a91 tempest-ProjectMemberTests-2060754872 None] Deleted volume successfully. Sep 04 16:11:41 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ecba62d6-b0fa-44ed-b39b-c58257b64a91 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-d11c6e9e-7b0d-4473-adba-2db089c16ead-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:41 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:11:41 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Flow 'volume_create_manager' (c5486290-f875-47d2-83f1-504f1bf1eae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a837becc-7fbc-4758-8f21-bfa0bf2ff30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a837becc-7fbc-4758-8f21-bfa0bf2ff30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-357135137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edee9e8d-8179-461f-b46e-8b6388b4676f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb01159052a40b287cf32491b8d265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:42Z,use_quota=True,user_id='bac5509d617040ee9cc4a5e5f8232b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3119b4ea-8bd3-4f2c-a599-ff8a262d5072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3119b4ea-8bd3-4f2c-a599-ff8a262d5072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d26145-f7b5-4cff-87b2-5ae1a6b56610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d26145-f7b5-4cff-87b2-5ae1a6b56610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edee9e8d-8179-461f-b46e-8b6388b4676f', 'volume_name': 'volume-edee9e8d-8179-461f-b46e-8b6388b4676f', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ef60a5-f786-4333-8807-1945db8c897c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ef60a5-f786-4333-8807-1945db8c897c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494aec0c-2c98-458a-8193-a5abcd13788d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:42 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Volume edee9e8d-8179-461f-b46e-8b6388b4676f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edee9e8d-8179-461f-b46e-8b6388b4676f', 'volume_size': 1} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-357135137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edee9e8d-8179-461f-b46e-8b6388b4676f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb01159052a40b287cf32491b8d265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:42Z,use_quota=True,user_id='bac5509d617040ee9cc4a5e5f8232b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Creating volume edee9e8d-8179-461f-b46e-8b6388b4676f {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:11:42 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:42 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f 1073741824 Sep 04 16:11:42 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:42 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f 1073741824" returned: 0 in 0.451s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:42 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f Sep 04 16:11:42 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:42 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f" returned: 0 in 0.242s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494aec0c-2c98-458a-8193-a5abcd13788d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edee9e8d-8179-461f-b46e-8b6388b4676f', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee370f7b-8979-4c2f-b381-e9291c969b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:42 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Volume volume-edee9e8d-8179-461f-b46e-8b6388b4676f (edee9e8d-8179-461f-b46e-8b6388b4676f): created successfully Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee370f7b-8979-4c2f-b381-e9291c969b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:42 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Flow 'volume_create_manager' (c5486290-f875-47d2-83f1-504f1bf1eae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:42 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-4475c216-af09-4519-b1d3-a38c45a9c148 tempest-ProjectMemberTests-2060754872 None] Created volume successfully. Sep 04 16:11:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-321c1ddc-1799-4475-8de4-e0d9cf05bb83 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-321c1ddc-1799-4475-8de4-e0d9cf05bb83 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:43 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-321c1ddc-1799-4475-8de4-e0d9cf05bb83 tempest-ProjectMemberTests-2060754872 None] Creating offline snapshot f105e60f-bbb9-4b67-90f7-416595e3e633 of volume edee9e8d-8179-461f-b46e-8b6388b4676f {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:11:43 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[40de0c52-92e4-4588-90a4-01a0442178a7]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-321c1ddc-1799-4475-8de4-e0d9cf05bb83 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:43 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f Sep 04 16:11:43 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:43 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-321c1ddc-1799-4475-8de4-e0d9cf05bb83 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f" returned: 0 in 0.337s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-321c1ddc-1799-4475-8de4-e0d9cf05bb83 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.f105e60f-bbb9-4b67-90f7-416595e3e633 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:43 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.f105e60f-bbb9-4b67-90f7-416595e3e633 1G Sep 04 16:11:43 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:43 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-321c1ddc-1799-4475-8de4-e0d9cf05bb83 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.f105e60f-bbb9-4b67-90f7-416595e3e633 1G" returned: 0 in 0.363s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:43 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-321c1ddc-1799-4475-8de4-e0d9cf05bb83 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edee9e8d-8179-461f-b46e-8b6388b4676f -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.f105e60f-bbb9-4b67-90f7-416595e3e633 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:43 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edee9e8d-8179-461f-b46e-8b6388b4676f -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.f105e60f-bbb9-4b67-90f7-416595e3e633 Sep 04 16:11:43 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:44 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-321c1ddc-1799-4475-8de4-e0d9cf05bb83 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edee9e8d-8179-461f-b46e-8b6388b4676f -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.f105e60f-bbb9-4b67-90f7-416595e3e633" returned: 0 in 0.273s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:44 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-321c1ddc-1799-4475-8de4-e0d9cf05bb83 tempest-ProjectMemberTests-2060754872 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.f105e60f-bbb9-4b67-90f7-416595e3e633 is being set with open permissions: ugo+rw Sep 04 16:11:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-321c1ddc-1799-4475-8de4-e0d9cf05bb83 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.f105e60f-bbb9-4b67-90f7-416595e3e633 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:44 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.f105e60f-bbb9-4b67-90f7-416595e3e633 Sep 04 16:11:44 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:44 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-321c1ddc-1799-4475-8de4-e0d9cf05bb83 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.f105e60f-bbb9-4b67-90f7-416595e3e633" returned: 0 in 0.242s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-321c1ddc-1799-4475-8de4-e0d9cf05bb83 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:44 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.info Sep 04 16:11:44 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:44 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-321c1ddc-1799-4475-8de4-e0d9cf05bb83 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.info" returned: 0 in 0.255s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:44 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-321c1ddc-1799-4475-8de4-e0d9cf05bb83 tempest-ProjectMemberTests-2060754872 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.info is being set with open permissions: ugo+rw Sep 04 16:11:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-321c1ddc-1799-4475-8de4-e0d9cf05bb83 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:44 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.info Sep 04 16:11:44 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:44 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-321c1ddc-1799-4475-8de4-e0d9cf05bb83 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.info" returned: 0 in 0.225s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:44 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-321c1ddc-1799-4475-8de4-e0d9cf05bb83 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.767s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:44 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-321c1ddc-1799-4475-8de4-e0d9cf05bb83 tempest-ProjectMemberTests-2060754872 None] Create snapshot completed successfully Sep 04 16:11:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-f105e60f-bbb9-4b67-90f7-416595e3e633-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-f105e60f-bbb9-4b67-90f7-416595e3e633-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-edee9e8d-8179-461f-b46e-8b6388b4676f" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-edee9e8d-8179-461f-b46e-8b6388b4676f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-f105e60f-bbb9-4b67-90f7-416595e3e633" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:45 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-f105e60f-bbb9-4b67-90f7-416595e3e633" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] Deleting offline snapshot f105e60f-bbb9-4b67-90f7-416595e3e633 of volume edee9e8d-8179-461f-b46e-8b6388b4676f {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:11:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] snapshot_file for this snap is: volume-edee9e8d-8179-461f-b46e-8b6388b4676f.f105e60f-bbb9-4b67-90f7-416595e3e633 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:11:45 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b2cf53-af4f-484d-95fc-01c9b4003bc3]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.f105e60f-bbb9-4b67-90f7-416595e3e633 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:45 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.f105e60f-bbb9-4b67-90f7-416595e3e633 Sep 04 16:11:45 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:45 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.f105e60f-bbb9-4b67-90f7-416595e3e633" returned: 0 in 0.340s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:45 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edee9e8d-8179-461f-b46e-8b6388b4676f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:11:45 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0945cf3-cefb-45f3-8642-be0dbfb77e70]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:45 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f Sep 04 16:11:45 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:45 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f" returned: 0 in 0.337s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:45 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.f105e60f-bbb9-4b67-90f7-416595e3e633 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:46 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.f105e60f-bbb9-4b67-90f7-416595e3e633 Sep 04 16:11:46 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:46 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.f105e60f-bbb9-4b67-90f7-416595e3e633" returned: 0 in 0.310s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.f105e60f-bbb9-4b67-90f7-416595e3e633 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:46 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.f105e60f-bbb9-4b67-90f7-416595e3e633 Sep 04 16:11:46 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:46 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:46 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f.f105e60f-bbb9-4b67-90f7-416595e3e633" returned: 0 in 0.232s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-f105e60f-bbb9-4b67-90f7-416595e3e633" released by "_delete_snapshot" :: held 1.300s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-edee9e8d-8179-461f-b46e-8b6388b4676f" released by "delete_snapshot" :: held 1.320s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:46 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] Created reservations ['37b6aaac-38b3-4d33-8eeb-71be8822be79', 'c6b5287f-5378-4e2c-845b-ba71b3b1c7d6', '5c3726a6-30ca-4c2b-ad09-0349af485e97', '80de98ee-74ec-45e7-aedb-a23351ce5fd4'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:11:46 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] Delete snapshot completed successfully. Sep 04 16:11:46 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-c1d71fbe-7015-4596-acca-fe8967193577 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-f105e60f-bbb9-4b67-90f7-416595e3e633-delete_snapshot" released by "delete_snapshot" :: held 1.447s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-430e6ea2-5777-4cc4-b31e-e89e0127a767 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-edee9e8d-8179-461f-b46e-8b6388b4676f-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-430e6ea2-5777-4cc4-b31e-e89e0127a767 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-edee9e8d-8179-461f-b46e-8b6388b4676f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-430e6ea2-5777-4cc4-b31e-e89e0127a767 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-edee9e8d-8179-461f-b46e-8b6388b4676f" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:47 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-430e6ea2-5777-4cc4-b31e-e89e0127a767 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-edee9e8d-8179-461f-b46e-8b6388b4676f" acquired by "delete_volume" :: waited 0.014s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:47 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d15943c-a947-4da6-b975-2a74d0edd0c6]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-430e6ea2-5777-4cc4-b31e-e89e0127a767 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:47 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f Sep 04 16:11:47 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:47 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-430e6ea2-5777-4cc4-b31e-e89e0127a767 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f" returned: 0 in 0.345s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:47 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-430e6ea2-5777-4cc4-b31e-e89e0127a767 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:47 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f Sep 04 16:11:47 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:48 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-430e6ea2-5777-4cc4-b31e-e89e0127a767 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-edee9e8d-8179-461f-b46e-8b6388b4676f" returned: 0 in 0.230s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-430e6ea2-5777-4cc4-b31e-e89e0127a767 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-edee9e8d-8179-461f-b46e-8b6388b4676f" released by "delete_volume" :: held 0.625s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-430e6ea2-5777-4cc4-b31e-e89e0127a767 tempest-ProjectMemberTests-2060754872 None] Created reservations ['e4f8aae1-d9c3-437e-ae2f-9b046a957387', '14214182-d8cd-468b-8374-0441457b57cf', '75cad5af-7a6f-4068-8bef-6d6c6f79983b', '3cac09e1-af50-444b-a1eb-39dabb5dfbf1'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-430e6ea2-5777-4cc4-b31e-e89e0127a767 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-430e6ea2-5777-4cc4-b31e-e89e0127a767 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-430e6ea2-5777-4cc4-b31e-e89e0127a767 tempest-ProjectMemberTests-2060754872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-430e6ea2-5777-4cc4-b31e-e89e0127a767 tempest-ProjectMemberTests-2060754872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-430e6ea2-5777-4cc4-b31e-e89e0127a767 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-430e6ea2-5777-4cc4-b31e-e89e0127a767 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:48 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:11:48 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:48 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-430e6ea2-5777-4cc4-b31e-e89e0127a767 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.251s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-430e6ea2-5777-4cc4-b31e-e89e0127a767 tempest-ProjectMemberTests-2060754872 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:11:48 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-430e6ea2-5777-4cc4-b31e-e89e0127a767 tempest-ProjectMemberTests-2060754872 None] Deleted volume successfully. Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-430e6ea2-5777-4cc4-b31e-e89e0127a767 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-edee9e8d-8179-461f-b46e-8b6388b4676f-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Flow 'volume_create_manager' (b6d6731b-e87d-4d83-8c81-7aa8a1710b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d014d4ea-b8cd-41eb-b9cf-6f49be594e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d014d4ea-b8cd-41eb-b9cf-6f49be594e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-123335697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d56ed3b-43ad-4124-be68-d52821bd7a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb01159052a40b287cf32491b8d265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:49Z,use_quota=True,user_id='bac5509d617040ee9cc4a5e5f8232b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6134aa7a-9e8a-402e-9aa9-15a09237a093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6134aa7a-9e8a-402e-9aa9-15a09237a093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0008c92-d810-4242-ba3b-6e158cd603d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0008c92-d810-4242-ba3b-6e158cd603d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d56ed3b-43ad-4124-be68-d52821bd7a67', 'volume_name': 'volume-3d56ed3b-43ad-4124-be68-d52821bd7a67', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1e34c1-da64-40a1-b6a0-edcb3602f983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1e34c1-da64-40a1-b6a0-edcb3602f983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67105612-a8a9-4fa9-9167-95db3059b280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:48 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Volume 3d56ed3b-43ad-4124-be68-d52821bd7a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d56ed3b-43ad-4124-be68-d52821bd7a67', 'volume_size': 1} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-123335697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d56ed3b-43ad-4124-be68-d52821bd7a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb01159052a40b287cf32491b8d265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:49Z,use_quota=True,user_id='bac5509d617040ee9cc4a5e5f8232b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Creating volume 3d56ed3b-43ad-4124-be68-d52821bd7a67 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:11:48 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:11:48 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:49 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67 1073741824 Sep 04 16:11:49 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:49 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67 1073741824" returned: 0 in 0.400s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:49 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67 Sep 04 16:11:49 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:49 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67" returned: 0 in 0.245s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:49 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:11:49 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67105612-a8a9-4fa9-9167-95db3059b280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d56ed3b-43ad-4124-be68-d52821bd7a67', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7734bf0f-e8eb-4784-8ad6-4ee5ad3a78cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:49 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Volume volume-3d56ed3b-43ad-4124-be68-d52821bd7a67 (3d56ed3b-43ad-4124-be68-d52821bd7a67): created successfully Sep 04 16:11:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7734bf0f-e8eb-4784-8ad6-4ee5ad3a78cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:49 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Flow 'volume_create_manager' (b6d6731b-e87d-4d83-8c81-7aa8a1710b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:49 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-07fe6ea9-ea64-4a72-9924-b963f178cc20 tempest-ProjectMemberTests-2060754872 None] Created volume successfully. Sep 04 16:11:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4331635b-9ef9-4041-9dc7-03e01706360b tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4331635b-9ef9-4041-9dc7-03e01706360b tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:50 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-4331635b-9ef9-4041-9dc7-03e01706360b tempest-ProjectMemberTests-2060754872 None] Creating offline snapshot bdb2c06b-b230-415e-9931-47e66982a1b6 of volume 3d56ed3b-43ad-4124-be68-d52821bd7a67 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:11:50 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d33035-c37c-4dac-b39b-cdfedea40f40]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4331635b-9ef9-4041-9dc7-03e01706360b tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:50 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67 Sep 04 16:11:50 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:50 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4331635b-9ef9-4041-9dc7-03e01706360b tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67" returned: 0 in 0.378s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4331635b-9ef9-4041-9dc7-03e01706360b tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.bdb2c06b-b230-415e-9931-47e66982a1b6 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:50 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.bdb2c06b-b230-415e-9931-47e66982a1b6 1G Sep 04 16:11:50 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:50 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4331635b-9ef9-4041-9dc7-03e01706360b tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.bdb2c06b-b230-415e-9931-47e66982a1b6 1G" returned: 0 in 0.369s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:50 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4331635b-9ef9-4041-9dc7-03e01706360b tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d56ed3b-43ad-4124-be68-d52821bd7a67 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.bdb2c06b-b230-415e-9931-47e66982a1b6 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:50 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d56ed3b-43ad-4124-be68-d52821bd7a67 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.bdb2c06b-b230-415e-9931-47e66982a1b6 Sep 04 16:11:50 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:51 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4331635b-9ef9-4041-9dc7-03e01706360b tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d56ed3b-43ad-4124-be68-d52821bd7a67 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.bdb2c06b-b230-415e-9931-47e66982a1b6" returned: 0 in 0.290s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:51 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-4331635b-9ef9-4041-9dc7-03e01706360b tempest-ProjectMemberTests-2060754872 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.bdb2c06b-b230-415e-9931-47e66982a1b6 is being set with open permissions: ugo+rw Sep 04 16:11:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4331635b-9ef9-4041-9dc7-03e01706360b tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.bdb2c06b-b230-415e-9931-47e66982a1b6 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:51 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.bdb2c06b-b230-415e-9931-47e66982a1b6 Sep 04 16:11:51 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:51 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4331635b-9ef9-4041-9dc7-03e01706360b tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.bdb2c06b-b230-415e-9931-47e66982a1b6" returned: 0 in 0.233s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4331635b-9ef9-4041-9dc7-03e01706360b tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:51 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.info Sep 04 16:11:51 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:51 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4331635b-9ef9-4041-9dc7-03e01706360b tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.info" returned: 0 in 0.253s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:51 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-4331635b-9ef9-4041-9dc7-03e01706360b tempest-ProjectMemberTests-2060754872 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.info is being set with open permissions: ugo+rw Sep 04 16:11:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4331635b-9ef9-4041-9dc7-03e01706360b tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:51 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.info Sep 04 16:11:51 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:51 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-4331635b-9ef9-4041-9dc7-03e01706360b tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.info" returned: 0 in 0.229s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:51 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-4331635b-9ef9-4041-9dc7-03e01706360b tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.829s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:51 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-4331635b-9ef9-4041-9dc7-03e01706360b tempest-ProjectMemberTests-2060754872 None] Create snapshot completed successfully Sep 04 16:11:52 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-bdb2c06b-b230-415e-9931-47e66982a1b6-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:52 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-bdb2c06b-b230-415e-9931-47e66982a1b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:52 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-3d56ed3b-43ad-4124-be68-d52821bd7a67" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:52 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-3d56ed3b-43ad-4124-be68-d52821bd7a67" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:52 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-bdb2c06b-b230-415e-9931-47e66982a1b6" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:52 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-bdb2c06b-b230-415e-9931-47e66982a1b6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] Deleting offline snapshot bdb2c06b-b230-415e-9931-47e66982a1b6 of volume 3d56ed3b-43ad-4124-be68-d52821bd7a67 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:11:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] snapshot_file for this snap is: volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.bdb2c06b-b230-415e-9931-47e66982a1b6 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:11:52 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[600e4902-98b0-493c-a132-d5e56120f579]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.bdb2c06b-b230-415e-9931-47e66982a1b6 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:52 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.bdb2c06b-b230-415e-9931-47e66982a1b6 Sep 04 16:11:52 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:52 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.bdb2c06b-b230-415e-9931-47e66982a1b6" returned: 0 in 0.346s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:52 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d56ed3b-43ad-4124-be68-d52821bd7a67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:11:52 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea85eb1c-191f-468c-b630-c487bc27bc94]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:52 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67 Sep 04 16:11:52 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:52 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67" returned: 0 in 0.340s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:52 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.bdb2c06b-b230-415e-9931-47e66982a1b6 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:53 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.bdb2c06b-b230-415e-9931-47e66982a1b6 Sep 04 16:11:53 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:53 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.bdb2c06b-b230-415e-9931-47e66982a1b6" returned: 0 in 0.320s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.bdb2c06b-b230-415e-9931-47e66982a1b6 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:53 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.bdb2c06b-b230-415e-9931-47e66982a1b6 Sep 04 16:11:53 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:53 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:53 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67.bdb2c06b-b230-415e-9931-47e66982a1b6" returned: 0 in 0.245s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:53 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-bdb2c06b-b230-415e-9931-47e66982a1b6" released by "_delete_snapshot" :: held 1.340s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:53 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-3d56ed3b-43ad-4124-be68-d52821bd7a67" released by "delete_snapshot" :: held 1.361s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:53 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] Created reservations ['f7f6730f-7054-4fc8-8cb0-df49558b2e0e', '38de47ce-aced-4fae-8e4c-9a1ebf972937', 'a3967bb1-c9f7-4f88-a2e8-8d2f35194cac', '4925406c-51ff-44ca-ac75-f1e0a8a00d26'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:11:53 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] Delete snapshot completed successfully. Sep 04 16:11:53 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-a7f14da4-03d2-4808-91a3-11b9f85f6356 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-bdb2c06b-b230-415e-9931-47e66982a1b6-delete_snapshot" released by "delete_snapshot" :: held 1.490s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6eee6142-5d88-4b3e-85eb-c48bc2ed78af tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-3d56ed3b-43ad-4124-be68-d52821bd7a67-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6eee6142-5d88-4b3e-85eb-c48bc2ed78af tempest-ProjectMemberTests-2060754872 None] Lock "cinder-3d56ed3b-43ad-4124-be68-d52821bd7a67-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6eee6142-5d88-4b3e-85eb-c48bc2ed78af tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-3d56ed3b-43ad-4124-be68-d52821bd7a67" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:54 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6eee6142-5d88-4b3e-85eb-c48bc2ed78af tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-3d56ed3b-43ad-4124-be68-d52821bd7a67" acquired by "delete_volume" :: waited 0.017s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:54 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5f963e-e306-4f2c-b423-eb2f9440facb]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6eee6142-5d88-4b3e-85eb-c48bc2ed78af tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:54 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67 Sep 04 16:11:54 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:54 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6eee6142-5d88-4b3e-85eb-c48bc2ed78af tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67" returned: 0 in 0.341s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:54 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6eee6142-5d88-4b3e-85eb-c48bc2ed78af tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:54 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67 Sep 04 16:11:54 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:55 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6eee6142-5d88-4b3e-85eb-c48bc2ed78af tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-3d56ed3b-43ad-4124-be68-d52821bd7a67" returned: 0 in 0.241s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6eee6142-5d88-4b3e-85eb-c48bc2ed78af tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-3d56ed3b-43ad-4124-be68-d52821bd7a67" released by "delete_volume" :: held 0.633s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:55 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-6eee6142-5d88-4b3e-85eb-c48bc2ed78af tempest-ProjectMemberTests-2060754872 None] Created reservations ['b9e46698-05df-41e3-a4eb-3ac180e2dd0b', 'b650dbba-cce0-4490-9c2a-133dfaead600', '330f0aa3-e610-4090-a691-e4b719ca6124', '7a3490d0-2dfc-4eb3-b403-2336872fd305'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:11:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6eee6142-5d88-4b3e-85eb-c48bc2ed78af tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6eee6142-5d88-4b3e-85eb-c48bc2ed78af tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6eee6142-5d88-4b3e-85eb-c48bc2ed78af tempest-ProjectMemberTests-2060754872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:55 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-6eee6142-5d88-4b3e-85eb-c48bc2ed78af tempest-ProjectMemberTests-2060754872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-6eee6142-5d88-4b3e-85eb-c48bc2ed78af tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6eee6142-5d88-4b3e-85eb-c48bc2ed78af tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:55 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:11:55 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:55 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:55 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-6eee6142-5d88-4b3e-85eb-c48bc2ed78af tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.243s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:55 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-6eee6142-5d88-4b3e-85eb-c48bc2ed78af tempest-ProjectMemberTests-2060754872 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:11:55 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-6eee6142-5d88-4b3e-85eb-c48bc2ed78af tempest-ProjectMemberTests-2060754872 None] Deleted volume successfully. Sep 04 16:11:55 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-6eee6142-5d88-4b3e-85eb-c48bc2ed78af tempest-ProjectMemberTests-2060754872 None] Lock "cinder-3d56ed3b-43ad-4124-be68-d52821bd7a67-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:11:55 devstack cinder-volume[87513]: DEBUG cinder.volume.flows.manager.create_volume [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:11:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Flow 'volume_create_manager' (a266ccd8-1012-4116-b82d-1058e53946d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84de6575-d030-4fe1-9129-adb88de05e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84de6575-d030-4fe1-9129-adb88de05e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1630638220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb01159052a40b287cf32491b8d265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:56Z,use_quota=True,user_id='bac5509d617040ee9cc4a5e5f8232b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81eeb682-5fa0-415d-9fd5-adafa0c71cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81eeb682-5fa0-415d-9fd5-adafa0c71cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71984890-e047-4d3a-8ab7-4ff30419ebb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:55 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71984890-e047-4d3a-8ab7-4ff30419ebb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0', 'volume_name': 'volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43083e4e-a51e-4ea8-a919-9e67aaa17bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43083e4e-a51e-4ea8-a919-9e67aaa17bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab7d5eb9-b4f7-418d-b0e3-b8c851bacb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:56 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Volume b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0', 'volume_size': 1} Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1630638220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb01159052a40b287cf32491b8d265c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:11:56Z,use_quota=True,user_id='bac5509d617040ee9cc4a5e5f8232b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45805279-8c8a-4787-99dd-5c35431ca5b2),volume_type_id=45805279-8c8a-4787-99dd-5c35431ca5b2)}" {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Creating volume b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0 {{(pid=87513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Selected osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e as target Quobyte volume. {{(pid=87513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Sep 04 16:11:56 devstack cinder-volume[87513]: INFO cinder.volume.drivers.remotefs [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] casted to osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0 1073741824 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:56 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0 1073741824 Sep 04 16:11:56 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:56 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0 1073741824" returned: 0 in 0.404s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:56 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0 Sep 04 16:11:56 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:56 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0" returned: 0 in 0.244s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'} {{(pid=87513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab7d5eb9-b4f7-418d-b0e3-b8c851bacb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0', 'volume_size': 1}' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8146e2e4-8662-4d70-9c56-1ed3f466d333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:11:56 devstack cinder-volume[87513]: INFO cinder.volume.flows.manager.create_volume [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Volume volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0 (b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0): created successfully Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8146e2e4-8662-4d70-9c56-1ed3f466d333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87513) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:11:56 devstack cinder-volume[87513]: DEBUG cinder.volume.manager [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Flow 'volume_create_manager' (a266ccd8-1012-4116-b82d-1058e53946d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87513) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:11:56 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-403141bb-0ae8-4448-a189-38cdd7e0e0d1 tempest-ProjectMemberTests-2060754872 None] Created volume successfully. Sep 04 16:11:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-308091f1-d762-4d3d-9131-b283b687616b tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:11:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-308091f1-d762-4d3d-9131-b283b687616b tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:11:57 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-308091f1-d762-4d3d-9131-b283b687616b tempest-ProjectMemberTests-2060754872 None] Creating offline snapshot b2020ce7-b11b-4262-b31b-49c672dfbc5b of volume b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0 {{(pid=87513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:11:57 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[306d0290-6e65-4eee-b696-b04346b54b1a]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-308091f1-d762-4d3d-9131-b283b687616b tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:57 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0 Sep 04 16:11:57 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:57 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-308091f1-d762-4d3d-9131-b283b687616b tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0" returned: 0 in 0.354s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-308091f1-d762-4d3d-9131-b283b687616b tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.b2020ce7-b11b-4262-b31b-49c672dfbc5b 1G {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:57 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.b2020ce7-b11b-4262-b31b-49c672dfbc5b 1G Sep 04 16:11:57 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:57 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-308091f1-d762-4d3d-9131-b283b687616b tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.b2020ce7-b11b-4262-b31b-49c672dfbc5b 1G" returned: 0 in 0.373s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:57 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-308091f1-d762-4d3d-9131-b283b687616b tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.b2020ce7-b11b-4262-b31b-49c672dfbc5b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:57 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.b2020ce7-b11b-4262-b31b-49c672dfbc5b Sep 04 16:11:57 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:58 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-308091f1-d762-4d3d-9131-b283b687616b tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0 -F qcow2 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.b2020ce7-b11b-4262-b31b-49c672dfbc5b" returned: 0 in 0.293s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:58 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-308091f1-d762-4d3d-9131-b283b687616b tempest-ProjectMemberTests-2060754872 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.b2020ce7-b11b-4262-b31b-49c672dfbc5b is being set with open permissions: ugo+rw Sep 04 16:11:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-308091f1-d762-4d3d-9131-b283b687616b tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.b2020ce7-b11b-4262-b31b-49c672dfbc5b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:58 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.b2020ce7-b11b-4262-b31b-49c672dfbc5b Sep 04 16:11:58 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:58 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-308091f1-d762-4d3d-9131-b283b687616b tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.b2020ce7-b11b-4262-b31b-49c672dfbc5b" returned: 0 in 0.234s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-308091f1-d762-4d3d-9131-b283b687616b tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:58 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.info Sep 04 16:11:58 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:58 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-308091f1-d762-4d3d-9131-b283b687616b tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.info" returned: 0 in 0.235s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:58 devstack cinder-volume[87513]: WARNING cinder.volume.drivers.remotefs [None req-308091f1-d762-4d3d-9131-b283b687616b tempest-ProjectMemberTests-2060754872 None] /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.info is being set with open permissions: ugo+rw Sep 04 16:11:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-308091f1-d762-4d3d-9131-b283b687616b tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.info {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:58 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.info Sep 04 16:11:58 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:58 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-308091f1-d762-4d3d-9131-b283b687616b tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.info" returned: 0 in 0.239s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:58 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-308091f1-d762-4d3d-9131-b283b687616b tempest-ProjectMemberTests-2060754872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.801s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:11:58 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-308091f1-d762-4d3d-9131-b283b687616b tempest-ProjectMemberTests-2060754872 None] Create snapshot completed successfully Sep 04 16:11:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-b2020ce7-b11b-4262-b31b-49c672dfbc5b-delete_snapshot" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-b2020ce7-b11b-4262-b31b-49c672dfbc5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0" by "delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-b2020ce7-b11b-4262-b31b-49c672dfbc5b" by "_delete_snapshot" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:11:59 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-b2020ce7-b11b-4262-b31b-49c672dfbc5b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:11:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] Deleting offline snapshot b2020ce7-b11b-4262-b31b-49c672dfbc5b of volume b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0 {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:11:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] snapshot_file for this snap is: volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.b2020ce7-b11b-4262-b31b-49c672dfbc5b {{(pid=87513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:11:59 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cef185-4669-4a45-8637-55f5186796de]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.b2020ce7-b11b-4262-b31b-49c672dfbc5b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:59 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.b2020ce7-b11b-4262-b31b-49c672dfbc5b Sep 04 16:11:59 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:11:59 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Sep 04 16:11:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.b2020ce7-b11b-4262-b31b-49c672dfbc5b" returned: 0 in 0.345s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:11:59 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.remotefs [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:11:59 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[7487821d-ec80-4b54-ae16-797af167903f]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:11:59 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:11:59 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0 Sep 04 16:11:59 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:12:00 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Sep 04 16:12:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0" returned: 0 in 0.342s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:12:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.b2020ce7-b11b-4262-b31b-49c672dfbc5b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:12:00 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.b2020ce7-b11b-4262-b31b-49c672dfbc5b Sep 04 16:12:00 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:12:00 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Sep 04 16:12:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.b2020ce7-b11b-4262-b31b-49c672dfbc5b" returned: 0 in 0.348s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:12:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.b2020ce7-b11b-4262-b31b-49c672dfbc5b {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:12:00 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.b2020ce7-b11b-4262-b31b-49c672dfbc5b Sep 04 16:12:00 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:12:00 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 04 16:12:00 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0.b2020ce7-b11b-4262-b31b-49c672dfbc5b" returned: 0 in 0.267s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:12:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-b2020ce7-b11b-4262-b31b-49c672dfbc5b" released by "_delete_snapshot" :: held 1.386s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:12:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0" released by "delete_snapshot" :: held 1.410s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:12:00 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] Created reservations ['94ccc67c-0fca-4095-8885-9da106ff6717', 'a51a24c0-57a2-4393-a61c-c7ffded1c1e4', '40bab419-c5dc-4601-9c80-8e60dac646b1', 'a2770c52-6f56-4ca8-b5b7-29b3c239094a'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:12:00 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] Delete snapshot completed successfully. Sep 04 16:12:00 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-610fd29b-506e-4e6f-8cf2-4329b454ae73 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-b2020ce7-b11b-4262-b31b-49c672dfbc5b-delete_snapshot" released by "delete_snapshot" :: held 1.538s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:12:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ae4845d3-832b-4f9e-bc98-93d279fd4ed2 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0-delete_volume" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:12:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ae4845d3-832b-4f9e-bc98-93d279fd4ed2 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:12:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ae4845d3-832b-4f9e-bc98-93d279fd4ed2 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "cinder-quobyte-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0" by "delete_volume" {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:12:01 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ae4845d3-832b-4f9e-bc98-93d279fd4ed2 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0" acquired by "delete_volume" :: waited 0.015s {{(pid=87513) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:12:01 devstack cinder-volume[87513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14da387-3754-477e-a7af-8faf4bb73527]: (4, 'qcow2') {{(pid=88475) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:12:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ae4845d3-832b-4f9e-bc98-93d279fd4ed2 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:12:01 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0 Sep 04 16:12:01 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:12:01 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Sep 04 16:12:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ae4845d3-832b-4f9e-bc98-93d279fd4ed2 tempest-ProjectMemberTests-2060754872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0" returned: 0 in 0.358s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:12:01 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ae4845d3-832b-4f9e-bc98-93d279fd4ed2 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:12:01 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0 Sep 04 16:12:01 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:12:02 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 04 16:12:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ae4845d3-832b-4f9e-bc98-93d279fd4ed2 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71/volume-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0" returned: 0 in 0.232s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:12:02 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ae4845d3-832b-4f9e-bc98-93d279fd4ed2 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-quobyte-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0" released by "delete_volume" :: held 0.643s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:12:02 devstack cinder-volume[87513]: DEBUG cinder.quota [None req-ae4845d3-832b-4f9e-bc98-93d279fd4ed2 tempest-ProjectMemberTests-2060754872 None] Created reservations ['3846d5b2-5905-46ad-a242-51d893c24430', '7173e83d-2b8d-4587-8ae1-a746ae50a4f1', 'fb784efb-c059-4ac9-b1d7-84e5faa60db5', 'f64de5fb-ce26-4bb3-b69b-e675238a789d'] {{(pid=87513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:12:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ae4845d3-832b-4f9e-bc98-93d279fd4ed2 tempest-ProjectMemberTests-2060754872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:12:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ae4845d3-832b-4f9e-bc98-93d279fd4ed2 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:12:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ae4845d3-832b-4f9e-bc98-93d279fd4ed2 tempest-ProjectMemberTests-2060754872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e': None} {{(pid=87513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Sep 04 16:12:02 devstack cinder-volume[87513]: DEBUG cinder.volume.drivers.quobyte [None req-ae4845d3-832b-4f9e-bc98-93d279fd4ed2 tempest-ProjectMemberTests-2060754872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d057e59-26eb-473b-a580-df5984ace23e'] {{(pid=87513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Sep 04 16:12:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.lockutils [None req-ae4845d3-832b-4f9e-bc98-93d279fd4ed2 tempest-ProjectMemberTests-2060754872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87513) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:12:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ae4845d3-832b-4f9e-bc98-93d279fd4ed2 tempest-ProjectMemberTests-2060754872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:12:02 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71 Sep 04 16:12:02 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:12:02 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Sep 04 16:12:02 devstack cinder-volume[87513]: DEBUG oslo_concurrency.processutils [None req-ae4845d3-832b-4f9e-bc98-93d279fd4ed2 tempest-ProjectMemberTests-2060754872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/262282b855f63db17f196661a5314d71" returned: 0 in 0.251s {{(pid=87513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:12:02 devstack cinder-volume[87513]: DEBUG cinder.manager [None req-ae4845d3-832b-4f9e-bc98-93d279fd4ed2 tempest-ProjectMemberTests-2060754872 None] Notifying Schedulers of capabilities ... {{(pid=87513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:12:02 devstack cinder-volume[87513]: INFO cinder.volume.manager [None req-ae4845d3-832b-4f9e-bc98-93d279fd4ed2 tempest-ProjectMemberTests-2060754872 None] Deleted volume successfully. Sep 04 16:12:02 devstack cinder-volume[87513]: DEBUG cinder.coordination [None req-ae4845d3-832b-4f9e-bc98-93d279fd4ed2 tempest-ProjectMemberTests-2060754872 None] Lock "cinder-b9c8df9a-46f5-4fa0-9f9a-7f5b036099d0-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87513) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:12:12 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:UPDATE=123,cinder:SELECT=101,cinder:INSERT=30,cinder:DELETE=8 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:12:12 devstack cinder-volume[87513]: DEBUG dbcounter [-] [87513] Writing DB stats cinder:SELECT=79,cinder:INSERT=36,cinder:UPDATE=129,cinder:DELETE=11 {{(pid=87513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}